Iodine tablets work for bacteria as well

You can also filter water using rocks/pebbles/dirt arranged in descending order base on size