Being an admin, I'd say no you wouldn't get banned for the actions of others based on IP. As each IP would be different, unless your behind a NAT, or proxy and have no real IP of your own. IN that case your SOL..
Another situation is if one of those said users becomes a really big recurring problem, where the admin might have to ban IP's. In that case an admin may just ban the entire range. I have done that in the past myself with some AOL users. 1 AOL user in particular forced me to ban a big range. In particular all philadelphia dialup AOL users.
So to answer your question, yes it can happen. Not knowing what exactly your network setup is I couldn't tell you. But if you have a real unique IP assigned to you, then you shouldn't worry too too much.