Sadly, most of what can be said at this point would be speculation. I personally don't find them that scary, but that's because of what is known. Basically, invert your natural instincts.
Charge at an Endermen if you do happen to look at one (because they freeze and don't do anything), and bash your sword into them. Unless Endermen have a "Zombie Pigmen" like property you'll never lose if you do this.
This video was confirmed fake, but it gives a good idea of what kind of threat Endermen are from what is known so far. Honestly, you're an idiot if you did this:
http://www.youtube.com/watch?v=DIeQgwEJUmsAs for blocks, I don't know what to say. It's no issue if they can only pick up dirt, gravel, or sand; but I guarantee you there'll be a huge outcry from many people if they can pick up any (or almost any) block.