You can tell that your friend is online and looking at your chat when the blue dot above the space bar flashes to a smiley. Even if there's no blue dot, you can still call or chat, but the person might not be online right away to see it.