The low level caves/dungeons are good spots to earn experience points once you reach adequate levels (they are not necessarily level appropriate with the rest of the surrounding area).
One of the fun/interesting things that happens in these dungeons / caves are Behests, where a Battle Warden will show up and allow you and/or your party to participate in clearing the cave of certain baddies, not unlike an additional guildleve (not credited against your 8, though). From my limited experience, these are generally not level appropriate to the surrounding zone at all, but if you go at it with a very large group it may be manageable. May be analogous to FFXI Assaults or Garrisons.
There is, however, no equivalent to Ragefire Chasm or Stormwind Stockades. Think of it more like Palborough Mines or Giddeus or Ghelsba Outpost with and extra little zone quest to gang up and do. From my experience, there is no "dungeon crawl" content, at least at these lower levels currently.