I haven’t had any issues with battery draining, it’s not that of a heavy app either

Try turning the notifications and background app refresh off, that should surely reduce the load on the battery