Congratulations on starting running!
A good rule of thumb is to increase by no more than 10% per week. About every 3 or 4 weeks, its a good idea to cut back for a week, and then continue to advance. This gives your body a chance to recover and re-energize.
I would also recommend only advancing your mileage on alternate days, depending on how often you run. So, for example, increase mileage a little bit on your Saturday, Monday and Wednesday runs. If those are days you are running. If you are running 6 times a week, take it easy on Sunday, Tuesday and Thursday. If you are only running 3 times a week, then I would not run on consecutive days, but might walk on the off days, or a very slow easy short run. If you run 4 or 5 times a week, adjust accordingly. You want to give your body a day between increased physical stress, whether you run that day or not.
Good luck, and let us know how you are doing!