| ▲ | Multiple Mouse Cursors in Wayland(blinry.org) |
| 109 points by marvinborner 7 hours ago | 71 comments |
| |
|
| ▲ | ofalkaed 4 hours ago | parent | next [-] |
| I have never liked split keyboards but I might if each keyboard was also a mouse with its own cursor, it seems fun to develop the skill to work that way. Would also be useful at times if the the Thinkpad trackpoint and trackpad could each have their own cursor and I could leave one somewhere. Or maybe a cursor stack like pushd/popd, registers would probably work better; instead of virtual desktops just give me one massive desktop with cursor locations I can jump between, switch to cursor 3 it saves the location of the current cursor and jumps. |
| |
| ▲ | voxadam an hour ago | parent | next [-] | | >I have never liked split keyboards but I might if each keyboard was also a mouse with its own cursor You might enjoy the KeyMouse (https://www.keymouse.com/). | |
| ▲ | MrDresden 2 hours ago | parent | prev [-] | | I have a UHK split keyboard with a keycluster module (which has a small trackball) on one the left half and a larger trackball module on the right half. Even though there is only one cursor it's been a really powerful way to work, being able to control the mouse with either thumb. Then there are the alternative keybindings that allow moving the mouse using the wasd keys as well. |
|
|
| ▲ | ben-schaaf 5 hours ago | parent | prev | next [-] |
| To add to the long list of caveats: This also breaks assumptions GUI toolkit and applications make about only one of their windows being focused at a time: `gtk_application_get_active_window`, `QApplication::activeWindow`, etc. |
| |
| ▲ | silon42 33 minutes ago | parent | next [-] | | Mouse pointer doesn't necessarily imply keyboard focus (for cursing)... but there is an issue for mouse enter/leave events, etc.. | |
| ▲ | ed_mercer 5 hours ago | parent | prev [-] | | I guess they could add a parameter cursorIndex defaulting to 0! |
|
|
| ▲ | kelnos 5 hours ago | parent | prev | next [-] |
| I'm building a compositor now, and I've been thinking about multi-seat from the beginning, but I know there are lots of places that assume a single seat, and so this sort of thing won't work for me. It's actually a lot more work than you'd think to support this... |
| |
| ▲ | jchw 4 hours ago | parent | next [-] | | Given that a lot of the use case is interacting with two different programs simultaneously, even just supporting it at the compositor level is pretty valuable: then it should "just work" for that use case. You can't really do a whole lot about the fact that most Wayland clients are making assumptions about seats; well, you can, but that's a lot more work... | |
| ▲ | bch 4 hours ago | parent | prev | next [-] | | > It's actually a lot more work than you'd think to support this... Like: how would one support multiple keyboards? Is there an experimental or logical model for that? | | |
| ▲ | anilgulecha 3 hours ago | parent | next [-] | | Multiple keyboards is trivial - unless you meant multiple active cursors. (If you've used a USB keyboard attahced to your laptop - you've already experienced multiple keyboards. Both work.) Multiple mice is esoteric. | | |
| ▲ | silon42 31 minutes ago | parent | next [-] | | Multiple mice (1 pointer) is not esoteric at all... I have a completely normal scenario with 3 (normal mouse, track pad, track point) right now. And at home, I have a mouse on the left side of the keyboard and another one on the right. | |
| ▲ | bch 2 hours ago | parent | prev | next [-] | | Of course you're correct re: laptop and aux kb - I was thinking of "seat" (and multiple seats) being: "Wayland seat refers to one 'seat' at which a user sits and operates the computer."[0] So a keyboard being attached to a seat, whose input might be associated w one active window, while another kb is associated with a different seat and different active window. Perhaps I'm just overthinking it. [0] https://wayland-book.com/seat.html | |
| ▲ | globular-toast 2 hours ago | parent | prev [-] | | If you have a USB mouse then you have multiple mice too, in that sense. |
| |
| ▲ | Fire-Dragon-DoL 3 hours ago | parent | prev [-] | | It's not a direct answer, but Nucleus Coop (Windows only) allows playing multiple instances of the same videogame with different savefiles and allow using multiple keyboards and mice (is it mice for the hardware thing?) It's an incredible hacky piece of software that does work by putting together like 10 oss. Incredible and cool. They have some UX around this |
| |
| ▲ | jauntywundrkind 5 hours ago | parent | prev [-] | | I keep thinking of trying to see how far I get re-doing Niri in River. The one other constraint that I'd really like to see relaxed is about displays, about being able to merge and subdivide screens as I please. Having a huge ultra-wide display really would be so much better if I could divide it up somehow. This is kind of the headline feature of stilch, which is a pretty neat compositor,
https://github.com/wegel/stilch . Niri has some tickets on it too. Merging monitors into a big display, and splitting a display (moments before the multi-pointer ticket was filed in Niri),
https://github.com/niri-wm/niri/discussions/1285
https://github.com/niri-wm/niri/discussions/3160 There's been all kinds of rough incredibly hard things going on with Niri just trying to figure out how to handle some of the more interesting copy-paste scenarios, and with really weird sequencing issues across basically ephemeral inputs, that have really plagued the project and made life incredibly bad for downstream apps. This is just my opinion, man, but I think the lack of ambition about these ridiculous over the top features eventually starts hampering what turns out to be relatively prosaic asks. Better models for multi-seat, multi-cursor help scenarios like remote-desktop, and video-chat remote control, that at first don't seem needed, but are fundamentals that pay dividends if you shoot for them. | | |
| ▲ | DiggyJohnson 2 hours ago | parent [-] | | It’s good to see the minimal drag to border behavior coming to all the OSs and DEs these days. I’m a weirdo and use i3 so I relate to this concern and am very comfortable with tiling for lots of applications. However there’s sometimes I wish I could just tell my display manager to treat the single WH wide monitor as two separate displays with dimensions, e.g. W(H-x) and W*(H+x). Not sure the best level to implement this. There’s probably already solutions for this now that I think about it… | | |
|
|
|
| ▲ | gorgoiler 2 hours ago | parent | prev | next [-] |
| I wish libinput gave the option for pointer inertia, where the pointer glides to a gradual rather than a hard halt after you stop moving it. I’m limited to a trackpad these days and it’s a really nice feature on my Steamdeck that I’d love to have on my Thinkpad. Come to think of it, Steamdeck is Wayland? How do they implement it? |
| |
| ▲ | gf000 40 minutes ago | parent | next [-] | | Semi-related - I think that controllers would be a very nice single input device for many kinds of workloads, especially if you can occasionally just dictate text. It's kind of sad that it's not supported all that well. | |
| ▲ | ben-schaaf 2 hours ago | parent | prev | next [-] | | > How do they implement it? In firmware. | |
| ▲ | rcxdude an hour ago | parent | prev [-] | | >I wish libinput gave the option for pointer inertia, where the pointer glides to a gradual rather than a hard halt after you stop moving it Why? That seems like it would make it a lot harder to move the cursor precisely. (in fact the main implementation of it on linux I know of was a joke in IOCC) | | |
| ▲ | fjalarhl an hour ago | parent | next [-] | | You'd think so but as the person above mentioned, this is how the steam deck/controller does it and it works well. It mostly affects faster movements like flicking the mouse across the screen, leaving smaller movements unaffected. | |
| ▲ | sublinear an hour ago | parent | prev [-] | | How precisely can you scroll on your phone? I don't think anyone finds it awkward. I get the impression that you're thinking of a much jankier implementation of "inertia" than that, and to be honest I wouldn't be surprised if that's what we'd get anyway. An unambitious inertia describes the linux community of the past decade pretty well. | | |
| ▲ | Gigachad an hour ago | parent [-] | | It works similarly to the steam deck actually. You flick and then tap/hold to stop. |
|
|
|
|
| ▲ | sciencesama 20 minutes ago | parent | prev | next [-] |
| and we can also assign this to particular apps like, mouse 1 and keyboard one can only interact with notepad !! etc !! |
|
| ▲ | eighty8days 2 hours ago | parent | prev | next [-] |
| This feels like a step in the right direction from this talk on desktop UX. Finally some cool innovation here! https://youtube.com/watch?v=1fZTOjd_bOQ |
| |
| ▲ | eqvinox 2 hours ago | parent [-] | | It's not quite innovation, from TFA: > X11 (the X Window System) has its own multi-seat extension called Multi-Pointer X (MPX), which I also had a lot of fun with a couple of years ago. |
|
|
| ▲ | zImPatrick 4 hours ago | parent | prev | next [-] |
| cant read the entire article on ios because the left part is just somehow cut off :( |
| |
| ▲ | Zetaphor 3 hours ago | parent [-] | | Same on Android, insane that people aren't validating for mobile in current year | | |
| ▲ | blinry an hour ago | parent | next [-] | | Insane author here. I think I just fixed this issue, if you wanna give it another try! | | | |
| ▲ | DANmode 3 hours ago | parent | prev [-] | | Reader Mode works great. Setting a minimum width that works on your screen is a bad habit that’s luckily mostly dead, in favor of responsiveness. |
|
|
|
| ▲ | AuthAuth 3 hours ago | parent | prev | next [-] |
| I have been dreaming about a split keyboard with dual trackballs and two cursors for the past few months. This may be the kick i need to actually get on it. |
| |
| ▲ | mtlsnk an hour ago | parent [-] | | Don't let your dreams be dreams; there is the Svalboard Datahand [0]. Though, you may need to sell a kidney to purchase it. In fairness to the creator, it's a niche product that would have taken quite some time to develop. I quite like BenVallack's video about the Svalboard [1] (and his videos in general about his journey through the world of split keyboards). [0] https://svalboard.com/ [1] https://youtube.com/watch?v=-Lz_FNoYHNM |
|
|
| ▲ | RobotToaster 3 hours ago | parent | prev | next [-] |
| After using a space mouse for CAD it always seems weird how dual mice isn't a more common thing. |
|
| ▲ | Jean-Philipe 2 hours ago | parent | prev | next [-] |
| Finally I get to play The Settlers II in split screen mode again |
|
| ▲ | roschdal 18 minutes ago | parent | prev | next [-] |
| Cool! Where can I get the turtle mouse cursor? |
|
| ▲ | QuaternionsBhop 6 hours ago | parent | prev | next [-] |
| I've always thought this was a cool idea. It's obviously been on the minds of Wayland protocol developers since the beginning, otherwise it wouldn't be possible! |
| |
| ▲ | grumbel 3 hours ago | parent | next [-] | | I thought it was the other way around, X11 has supported multiple cursor since 2009 and Wayland didn't add support for it since toolkit developers weren't making use of it anyway. Enabling in X works via: xinput list # find second mouse id
xinput create-master second
xinput reattach <mouse-id> "second pointer"
and to get rid of it: xinput reattach <mouse-id> 'Virtual core pointer'
xinput remove-master 'second pointer'
Works great for clicking, but keyboard doesn't work in some applications when enabled. Dragging windows might attach them to the wrong cursor and other issues. Playing around with xinput can also crash some apps (libgdk-3 here) or leave you in a state without a keyboard or mouse. | |
| ▲ | dmitrygr 4 hours ago | parent | prev [-] | | Wayland: you can have two cursors but no, you can’t have screen sharing. | | |
| ▲ | nvme0n1p1 4 hours ago | parent | next [-] | | Which desktop are you running where you can't figure out how to take a screenshot? Maybe some of the more tech-savvy folks here at HN can help you figure it out. | | |
| ▲ | dmitrygr 4 hours ago | parent | next [-] | | Yes. Show me how to make zoom screen sharing work without pipewire and prayer. | | |
| ▲ | nvme0n1p1 4 hours ago | parent | next [-] | | Since you edited your post I'll rephrase my question: Which desktop are you running where you can't figure out how to share your screen? Maybe some of the more tech-savvy folks here at HN can help you figure it out. | | |
| ▲ | dmitrygr 3 hours ago | parent [-] | | KDE plasma. go wild. | | |
| ▲ | nvme0n1p1 3 hours ago | parent [-] | | Here's a post from 2023 where the majority of people say it just works, except for one guy who tweaked his env and broke it. https://www.reddit.com/r/kde/comments/18gfffw/is_zoom_still_... The fact you're griping about implementation details like pipewire makes me think you also tried micromanaging your env and broke something. If you use a fresh install and leave everything default, I'm sure it would work for you like it does for everyone else. I use KDE too btw. | | |
| ▲ | arxari an hour ago | parent | next [-] | | > micromanaging your env All the "micromanaging" you need to do to not have screensharing is one of the following;
1. Don't have a started dbus session
2. Don't have portals installed and setup
3. Don't have pipewire installed and setup Meanwhile on X what you need is:
1. Have X So no, it wouldn't work, the reason why it works for those people in the Reddit post is because they use distros and sessions that do all the things I listed that make screensharing not work if any one is not done. PS: Wayland does have testing protocols for screenshots and screenrecording like 'wlr-screencopy' and some DMA buff one I forgot the name of. But for screen sharing there's nothing that Wayland implements itself afaik. | | |
| ▲ | gf000 an hour ago | parent [-] | | Without dbus, X would also have plenty of its features fall flat, it's the de facto IPC mechanism of Linux desktop for better or worse, so it's like "my car won't start if I don't have any fuel" complaint. |
| |
| ▲ | Lammy an hour ago | parent | prev [-] | | >micromanaging your env PERSONAL Computer | | |
| ▲ | gf000 44 minutes ago | parent [-] | | Sure, but if one wants to play tester, don't complain when you eventually find a bug. |
|
|
|
| |
| ▲ | opan 3 hours ago | parent | prev [-] | | Is there a reason you don't want to use pipewire? |
| |
| ▲ | fsckboy 4 hours ago | parent | prev [-] | | screen sharing is not a static screencap that you would need to email or something | | |
| ▲ | nvme0n1p1 4 hours ago | parent [-] | | He edited his post to say something different. Nonetheless I'm leaving my original comment as is. |
|
| |
| ▲ | dismalaf 3 hours ago | parent | prev [-] | | Screen sharing has been fine out of the box on every Wayland desktop I've used. |
|
|
|
| ▲ | chmod775 4 hours ago | parent | prev | next [-] |
| The more "typical" use for a feature like this is drawing tablets and touch screens. You don't necessarily want a touch/drawing tablet input to move your actual "main" mouse cursor. |
| |
| ▲ | gizmo686 3 hours ago | parent [-] | | Wayland has a separate wl_touch type that is also associated to a wl_seat. So that use case can be accomplished on a single seat setup. |
|
|
| ▲ | Dwedit 4 hours ago | parent | prev | next [-] |
| Focus of controls is the hard part. You end up needing a Per-seat version of focus in an application. |
| |
|
| ▲ | OsrsNeedsf2P 2 hours ago | parent | prev | next [-] |
| This is actually something I've always wanted, but people told me it's dumb. I want two cursors and two keyboards, with two "focused window" panes. If Mouse A clicks Pane1, keyboard A presses should go into Pane1. I think this would be so fun for multiplayer games on the same computer for example (think two Minecraft instances running). |
|
| ▲ | McGlockenshire 5 hours ago | parent | prev | next [-] |
| The original title, "State of multi-player Wayland" is a much better summary of the article. This ain't just about the pointers! In fact, the author is very explicit about that: > I think there could be a term that’s describing this concept even better – in the title of this post, I picked “multi-player”, to make clear that it’s mostly about multiple people who are collaborating. I’ve also seen “multi-cursor” or “multi-pointer” (which are missing the keyboard component). |
|
| ▲ | evertheylen 5 hours ago | parent | prev | next [-] |
| It's not as weird as you might think: laptops may have touchscreens (which can be multi-touch) on top of the "normal" cursor. IIRC, X.org can't really handle such cases cleanly. |
| |
| ▲ | kelnos 5 hours ago | parent [-] | | That's not what this article is about. You still only have one mouse cursor in that case, but two things (the touchscreen and touchpad) drive it. This is about actually having multiple, independent mouse cursors on the screen at once, with different input devices controlling different cursors. | | |
| ▲ | minitech 5 hours ago | parent [-] | | Sometimes that's true, but sometimes (imo the superior approach) the touchscreen is independent from the cursor. I think touchscreen Chromebooks are like that, for example. | | |
| ▲ | bee_rider 3 hours ago | parent [-] | | Oh, that seems like it would be quite nice, actually. It is vaguely annoying when my touchscreen moves my mouse cursor. | | |
| ▲ | rcxdude an hour ago | parent [-] | | It depends on the DE and the application to some extent. The touch events are seperate to mouse events and the mouse cursor moving, but AFAIK usually there is an emulation layer for compatibility with applications that don't support touch events which also moves the cursor, and this behaviour can change depending on the application (either it sets some flag or responds to the touch events in some way). Digitizer pens are the same way. |
|
|
|
|
|
| ▲ | nomel 5 hours ago | parent | prev | next [-] |
| Another possible use case might be mixed reality/VR displays, for simultaneous mouse cursor + eye tracking/control. |
|
| ▲ | jumperabg 4 hours ago | parent | prev | next [-] |
| Imagine working with two separate mouses at the same time - no keyboard. |
|
| ▲ | bsder 3 hours ago | parent | prev | next [-] |
| Maybe RedHat should contract this guy to finally get pointer warp implemented for Wayland everywhere it needs to be. |
|
| ▲ | jauntywundrkind 5 hours ago | parent | prev | next [-] |
| On the web, PointerEvents and touch events both support multiple different cursors. https://developer.mozilla.org/en-US/docs/Web/API/Touch_event... https://developer.mozilla.org/en-US/docs/Web/API/PointerEven... |
|
| ▲ | jchw 5 hours ago | parent | prev | next [-] |
| On the note of the two different kinds of seats, a tangent: better multi physical seat support is something I am passionate about, specifically, I want Windows-style "Fast User Switching" on Linux with RDP. Today's Linux RDP support usually acts like screen mirroring; you get a mirror of a physical seat. With GNOME I believe there is also now support to do remote login: you can log in remotely, and even disconnect and reconnect to a remote login session. But what you can't do is continue a physical session remotely or a remote session physically, and the reason why is sorta to do with seats. Sort of. See, when you start a graphical session on modern systemd-based Linux, a new logind session is created, and it is immutably tied to a seat. So you can't just remove the seat from a running logind session and then make it remote, or add the seat to a running logind session and make it physical. I actually tried patching systemd-logind to do this, but when I proposed it upstream, Lennart Poettering himself actually took the time to explain that this wasn't the intended way to do it: instead, you would actually just create a new logind session and drop the old one entirely, or literally whatever you want. Which to me sounded perposterous, but then I realized that it really wasn't that ridiculous. As it was, when you boot a desktop using systemd-logind, the desktop itself doesn't typically run much of anything directly in the session context anyway - the compositor and almost all services actually run as user services, as in systemd-land having more than one active desktop session per user isn't really supported. Okay so we can do this! And so I set out to prototype this with KDE, but there are still a few issues... - First and foremost, $XDG_SESSION_ID. Believe it gets set by the systemd PAM module somehow? I don't fully recall. Either way, it gets used by various programs to determine the current logind session, but if our graphical session can "roam" between them we need a mechanism that can handle changing over time. I propose we stuff the current logind session ID into a file in $XDG_RUNTIME_DIR instead. - Secondly, compositors need to be redesigned to handle this. Compositors today can hotplug displays and input devices - that's a good start. Unfortunately, at least kwin can't switch backends at runtime. You can really go one of two ways, and I tried a bit of both and either can work but both are a bit ugly: one is to make a single backend that can handle either case and the other is to allow switching the backend at runtime. Either way, when running remotely the card* DRM nodes are unavailable so you need to switch to renderD* nodes instead. You can also use both, and only use card* for scanout when available, but it seems a bit trickier. - Finally, I genuinely have no idea how this could or should be handled in non-systemd environments. I have admittedly forgotten how that all works. It would be rather lame to simply require logind for this to work, but sadly it is the path of least resistance at least at first. And maybe some more, but otherwise the concept does indeed broadly work. I mainly have only tested it in virtual machines with DRM native context, but I can see everything working switching in either direction at least once before things start to get screwed up. Even OpenGL clients and audio playback can move seamlessly! It's just like what Windows accomplished over 20 years ago! Aside from convenience and being cool, it would also solve a couple problems. No need to worry about the limit of only one session per user: just move your session with you. No need to worry about your physical session being unlocked when remotely connected: when you log in this way your physical seat gets disconnected from the session entirely and the display manager takes it back over. I actually would really like to at least make some progress on ground work that would be needed to make this happen, although I'm not really that sure that anybody cares. But either way this post's brief discussion about physical vs logical seats activated a few neurons so I couldn't help but dump this out. |
| |
| ▲ | rcxdude an hour ago | parent [-] | | I would appreciate this as well, TBH. Window's handling of remote desktop has been well ahead of linux's for a long time, but there's an irritating artificial limit of one active user on most versions of windows. Last I looked, even just headless wayland was still very awkward to use. |
|
|
| ▲ | kahf56 3 hours ago | parent | prev [-] |
| Now I know why Web devs, frontend developers hate us |