(Proverbs 12:24 KJV) The hand of the diligent shall bear rule: but the slothful shall be under tribute.
You say you don’t want to “rule” (4910)? You say you are more into servanthood? That is good if it is true, however part of being a servant of Jesus is being a steward of what He has put in your care. There are times when you cannot do that faithfully if you are not ruling.
Keep in mind that the contrast of the context is being “slothful” (slack NASB) (7423b) and being “under tribute” (forced labor NASB) (4522), not being obedient. As a servant of Jesus you don’t want to be in that group of common labor that has no skills and little to offer. We are not called to that.
Focus on being the “hand” (3027). You are the hands of Jesus bringing His rule to your life and the world around you.
So? Yes, Jesus needs people to scrub toilets, literally and metaphorically. Either way you are expected to be the king of the scrubbers. Serve well.