[Feature Request] - capture mouse while mouse down

[leon]

UE Version:
E.g. UE 5.5.0

Frontend Version:
E.g. UE5.5-0.4.0

Problem component
Frontend

Description
I have a project which is setup with

DefaultViewportMouseCaptureMode=CaptureDuringMouseDown
DefaultViewportMouseLockMode=DoNotLock

I want the user to be able to look around as long as they have their mouse button pressed.
The bug request is that if I press the mouse button, keep it pressed and move my cursor outside the video element, the mouse stops sending commands to unreal.

I think this could be solved by using
https://developer.mozilla.org/en-US/docs/Web/API/Element/setPointerCapture
So that even though we move outside the video element the mouse is continuing to send events.

Expected behavior
When pressing the mouse left button and moving I should look around in pixel streaming world until I let go of the mouse.
it should not matter where my cursor is.

[mcottontensor]

If you use "Locked Mouse" in the UI/Control Scheme options on the frontend the mouse will remain locked to the viewport of the stream once you click on it and remain locked until you hit esc. Is this something that will solve your issue or are we thinking of different situations?

[leon]

My situation is I'm developing an interactive apartment.
I never want to lock the mouse because it's not a game, and I don't like that interaction model.
it's more of a click interactive setup.

the only time I want to lock the interaction is when the mouse button is pressed.

So no, it would not solve my problem.

[mcottontensor]

I see what you mean. We don't implement anything like that currently. You would have to implement a solution yourself.

We would be happy to accept any PR you might end up with when implementing this. I would look into the existing control schemes for hints on the best way to approach it.