Yes you can set chanserv so that only users on the room’s access list can enter. This would require that these users register their nickname with nickserv so that they can be added to your room’s access list. Try /chanserv help for more information while in your chat room.