Will this bulk up my muscles?

For slender toned arms you need a decent amount of muscle and a small amount of fat. Weight lifting doesn't turn the fat into muscle it makes the muscles grow ( when done properly). It is very hard for women to build big muscles so don't be afraid of looking bulky. I train my biceps with 8kg (17.5lb) and my triceps with 4kg (about 8.5 lb) and I don't have big arms. They are shapely and very toned and don't wobble, i've only been training 10 months. My body fat percentage is healthy but pretty low for a woman, this is the key. So if I were you I would get some heavier weights, eat more protein, cut out all the junk from my diet. Get on youtube and have a look at some weight training exercises. Bicep curls, tricep extensions, tricep dips. Working on your shoulders will help shape the arms too. Good luck, it is very rewarding.