...you mean walking around trying to not get lost? Yeah, really sporty that one.
Considering that there's several disciplines of it (foot and bicycle for summer, trail for the Paralympics, and ski for the Winter Games), a World Cup of it, World Championships, a junior world championships, and is competed at the World Games (which is basically an Olympics with non-Olympic sports), there would be plenty of interest in it. It's race adventuring, basically. And you can't claim it's not "sporty" enough, especially if
Equestrian contested at the Olympics already. And with the world trying to go green, this would be an ideal addition, especially since it labels itself as such.
http://www.orienteering.org/i3/index.php?/iof2006
Roller hockey would have to have both quad and inline. You may have an issue with inline, as the top three countries are the US, Canada, and Finland. It's a pretty big drop off from those three. However, on occasion ice players do play for their inline national team. There was a World Championships a few years ago that had the Oilers' Ales Hemsky compete for the Czech Republic. If you can get a handful of NHLers willing to compete during the summer, I think there wouldn't be much resistance. Quad would be dominated by Spain and Portugal as well, I'm not familiar with it as I am inline, though. But still, it would be really neat to see.
Karate SHOULD be in, it's far more entertaining to watch and follow than judo, at least in my opinion. Wushu and caporeia as well.
I think you can argue why cricket shouldn't be in the same way you can argue against baseball. Cricket is popular in certain regions (England, Caribbean, Australia, India and Pakistan), but not others (North America, South America, East Asia). With baseball you have North America, Latin America, Caribbean again, East Asia, but a lack of interest in Europe (save for the Netherlands) and India/Pakistan. That said, I have nothing against cricket, in fact I think it's a really interesting sport, and I wouldn't have a problem at all with it being added. It should be, in fact, although it would have to be Twenty20.
Lacrosse would have a little bit of an issue since it's not very popular outside North America. However, it would be interesting to see how the IOC goes about it, especially since the three traditional powers are Canada, the US, and the Iroquois Nation. I'm not familiar with the IOC's policies towards allowing First Nations to compete in the Olympics, if they'd be allowed to or not (they are sovereign nations, after all.) I don't think Canada would have too much of a problem with it if they added lacrosse to the schedule, it would make it a bit more competitive.
Looking at the World Championships results for lacrosse, the only other country to do well outside of the Big 3 is Australia. Also judging from this, though, there wouldn't be a lack of countries competing, although how competitive they'd be is another story.
http://en.wikipedia.org/wiki/2006_World_Lacrosse_Championship
Skateboarding should be in, as should street luge. You may get some resistance from the older crowd who will not accept them since they're "X-Games sports", but you also have to consider the amount money the IOC can make off the competitions. Plus Shaun White competes in skateboarding. It would be marketing heaven for the Olympics.
Also, how about speed roller skating? A number of Olympics medalists in speed skating during the Winter Games (Derek Parra being one off the top of my head) came from roller skating. There's also artistic roller skating (figure skating, more or less), although how competitive that is I'm not sure.