What does sim mean in anime?

In anime, dating sim is shorthand for dating simulation.

What do you call a anime game?

It seems to be a clumsy way to refer to what is more commonly simply called an anime game, or anime based game. Anime games can be of other genres than bishojo games, like the Dragonball Z fighting games, the Super Robot Wars strategy games, or the Macross arcade shooters.