My wife got me a kit for Christmas this past year from Cabela's. (yeah she's awesome!) she didn't realize that Cabela's is about 2 hours from home until she got there lol. Anyways, don't know how much it cost but it came with everything I needed to start. Vise, small tying guide, hooks, thread, wire, lead wrap, bobbin, whip finish, scissors, bead heads, stretch tubing, feathers (hackle, marabou, peacock, pheasant tail, etc...) dubbing, head cement, and I'm sure I'm missing some stuff. I love it. I've used up almost all my hooks cause I'm too poor to buy any more at the moment (yeah thats pretty bad), but it's given me all the materials I need to start out. You're always going to want more; more variety, more tools, more this, more that. But my kit has served me well and I'll just keep adding to it as I get more addicted to the sport. Good Luck and have fun with it. Tying takes a while and if you're not having fun with it then you might as well go out and buy your flies. just my 2 cents.
p.s. A video might be good to start out. But with the internet and this board, you can figure out just about anything. There's video's and tying instructions all over the net and these guys have helped me with all my problems. Just start tying and when you hit a speedbump, just ask someone on here. Thats what everyone's on here for.