Xbox joystick occasionally moving up on its own when tilting controllr

It seems my right joystick occasionally will move up on its own when my controller isn't straight or on a flat surface, for example every now and now I would tilt my controller down and on the screen, it shows the right joystick is moving upwards based on how much I tilt the controller. If it's stick drift then its a very strange case of it I've never seen.