is multi touch HID possible with nrf51822 chip?

RE: is multi touch HID possible with nrf51822 chip?

ovrebekk — Wed, 02 Nov 2022 16:02:57 GMT

Hi Leon

Have you tried to connect a high end mouse and keyboard that supports Bluetooth to the devices, such as the Logitech MX Master mouse and MX Keys keyboard?

Then you can see if there are any of the standard mouse and keyboard controls that will work across all the platforms, and do what you need it to do.

Best regards
Torbjørn

RE: is multi touch HID possible with nrf51822 chip?

Leon — Wed, 02 Nov 2022 03:00:02 GMT

Hi Torbjørn

Thanks for the guide, I used two methods to control the video.
1. Use hid devices that simulate touch, but cannot be used on ios and windows.
2. Use the hid device that simulates mouse sliding and left button, but encountered the problems you mentioned.
Now I haven't thought of any other way to do it.

Best regards

Leon

RE: is multi touch HID possible with nrf51822 chip?

ovrebekk — Mon, 31 Oct 2022 08:26:16 GMT

Hi Leon

As far as I know there is no way for a HID mouse to know the screen size of the device that it is connected to, and an implementation that require you to find a specific point of the screen is bound to be unreliable across different types of phones.

Have you investigated if there is some other way to control the video that doesn't require you to simulate a touch, such as sending a vertical or horisontal scroll command?

Best regards
Torbjørn

RE: is multi touch HID possible with nrf51822 chip?

Leon — Fri, 28 Oct 2022 08:27:02 GMT

Hi Torbjørn

I am going to make a bluetooth controller. When watching videos with a mobile app, I can control the video to slide up and down (similar to sliding a finger up and down the screen to switch videos).
I can only use the HID mouse example now to achieve this function (similar to the bluetooth mouse to control the video up and down), but for how to position the mouse pointer to the specified position of the phone screen (for example, to the center of the screen), and I found the position of Android phone is different from that of Apple's location.

Attached is my code.devzone.nordicsemi.com/.../8171.main.c

Best regards

Leon

RE: is multi touch HID possible with nrf51822 chip?

ovrebekk — Fri, 28 Oct 2022 06:51:27 GMT

What are you actually trying to implement?

This example is quite old and outdated by now, and is not really suitable for new designs.

These days we have moved development over to the nRF Connect SDK, and at some point it will be mandatory to use this software platform if you want to qualify new Bluetooth products.

Best regards
Torbjørn

RE: is multi touch HID possible with nrf51822 chip?

Leon — Fri, 21 Oct 2022 03:28:13 GMT

Hi Ovrebekk

Thanks for sharing the file.

I have been able to test this successfully on Android,but I haven't been able to test this successfully on Windows and ios,what do i need to modify to work on windows and ios.

Best regards

Leon

RE: is multi touch HID possible with nrf51822 chip?

ovrebekk — Tue, 28 Jan 2020 08:16:38 GMT

Hi Matthew

I am not sure how much help this project would be. Essentially I designed it to debug multi touch functionality. I tested it with an Android app called Multi Touch Test, and when pressing Button 4 on the kit repeatedly you should eventually see multiple points on the screen touched at the same time.

I never got it working quite as I expected, so it is not really a project I would recommend for other use cases. It does not try to replicate swipe either, this would probably require a different descriptor.

Best regards
Torbjørn

RE: is multi touch HID possible with nrf51822 chip?

matt_wilson — Mon, 27 Jan 2020 02:24:53 GMT

I was finally able to get it to compile by using the SDK 15.2. What was the goal of the DZ213974_ble_app_hids_mouse project. What type of functionality should I expect for each button? I have been testing with my Mac and get some response but get nothing on my iPhone XS.

Would this project set me on the path of reproducing a finger swipe across an iPhone? I'm trying to reproduce a up/down/left/right finger swipe on the iPhone for scrolling. I have had my customers ask about adding this feature to a product I sell. I purchased a cheap remote from China that has the exact functionality I'm looking for. Been trying to figure out how it's working with the phone. I have the packet logs from logging the traffic but not making any progress with them because never had to go that deep into the protocol.

Thanks for any advice you may have.

RE: is multi touch HID possible with nrf51822 chip?

matt_wilson — Sun, 26 Jan 2020 16:20:35 GMT

Hi Ovrebekk,

I'm working on a similar solution where I need the capability to reproduce a up/down/left/right finger swipe on an iPhone that performs a scroll effect. I'm working with the nrf52832 DK and when I try to compile I get the following error. Do you have any advice?

Thanks...

Building ?ble_app_hids_mouse_pca10040_s132? from solution ?ble_app_hids_mouse_pca10040_s132? in configuration ?Debug?
1> Compiling ?fds.c?
2> Compiling ?hardfault_implementation.c?
3> Compiling ?nrf_assert.c?
1> In file included from /Users/matt/Documents/Nordic/nRF5_SDK_15.3.0_59ac345/components/libraries/fds/fds.c:43:
1> /Users/matt/Documents/Nordic/nRF5_SDK_15.3.0_59ac345/components/libraries/fds/fds_internal_defs.h:93:39: error: 'FDS_VIRTUAL_PAGES_RESERVED' undeclared (first use in this function); did you mean 'FDS_VIRTUAL_PAGE_SIZE'?
1> /Users/matt/Documents/Nordic/nRF5_SDK_15.3.0_59ac345/components/libraries/fds/fds.c:1645:24: note: in expansion of macro 'FDS_PHY_PAGES_RESERVED'
1> /Users/matt/Documents/Nordic/nRF5_SDK_15.3.0_59ac345/components/libraries/fds/fds_internal_defs.h:93:39: note: each undeclared identifier is reported only once for each function it appears in
1> /Users/matt/Documents/Nordic/nRF5_SDK_15.3.0_59ac345/components/libraries/fds/fds.c:1645:24: note: in expansion of macro 'FDS_PHY_PAGES_RESERVED'
4> Compiling ?nrf_atfifo.c?
Build failed

RE: is multi touch HID possible with nrf51822 chip?

ovrebekk — Fri, 30 Nov 2018 14:42:00 GMT

You welcome 🙂

RE: is multi touch HID possible with nrf51822 chip?

akash naidu — Fri, 23 Nov 2018 14:01:17 GMT

Just now I have tested with Moto g5 plus phone,it has been working as expected.

Tomorrow I will test on windows, and will let you know the result.

Heartly appreciate your support.

Akash.

RE: is multi touch HID possible with nrf51822 chip?

ovrebekk — Fri, 23 Nov 2018 13:53:33 GMT

No worries, take all the time you need 🙂

Best regards
Torbjørn

RE: is multi touch HID possible with nrf51822 chip?

akash naidu — Tue, 20 Nov 2018 05:46:46 GMT

Sorry for late reply.

I have been busy with another task. If i got time to test, will test and let you know.

Thanks for your whole support.

Akash.

RE: is multi touch HID possible with nrf51822 chip?

ovrebekk — Wed, 14 Nov 2018 14:52:14 GMT

That is very odd.

I double checked the test with 4 phones, and it never crashed. 3 of the phones also showed the button presses, while my old Nexus 5 didn't (but there was no crashes).

To make sure you run the test completely from scratch it is recommended to completely erase the flash of the nRF52DK, and to change the BLE address to avoid the phone trying to reconnect to it.

To change the address just increment one of the address bytes on line 445 of main.c by one, and rebuild the project (ie, change byte 4 from 0x33 to 0x34).

To erase the flash click on Menu -> Target -> Connect J-Link, followed by Menu -> Target -> Erase All

After that you have to flash the application again.

Also, if you can get or borrow an Android device from a different manufacturer it would be interesting to see if that works better.

I have got it to work on the Huawei P20 Pro, the Nexus 5X and the Samsung Galaxy S8.

Best regards
Torbjørn

RE: is multi touch HID possible with nrf51822 chip?

akash naidu — Fri, 09 Nov 2018 04:48:42 GMT

Hi Ovrebekk

I have tested it with workaround, but i was getting same error

info> app: HID Mouse example started.
<info> app: m_whitelist_peer_cnt 1, MAX_PEERS_WLIST 8
<info> app: Fast advertising.
<info> app: Connected
<error> app: Fatal error
<warning> app: System reset

I am testing with Redmi Notepad 4.

Best Regards,

Akash

RE: is multi touch HID possible with nrf51822 chip?

ovrebekk — Wed, 07 Nov 2018 13:23:17 GMT

Hi Akash

Please let me know once you had time to test it.

Best regards
Torbjørn

RE: is multi touch HID possible with nrf51822 chip?

akash naidu — Tue, 06 Nov 2018 11:19:20 GMT

Hi Ovrebekk

I will test it again with this workaround.

Best Regards

Akash

RE: is multi touch HID possible with nrf51822 chip?

ovrebekk — Tue, 06 Nov 2018 08:50:10 GMT

Hi Akash

I also get an error now when trying to send data. The error I get is 0x3401, which is the 'system attributes missing' error.

This is interesting, as I can't remember seeing this issue before.

I need some more time to investigate this, but one quick workaround that allows me to send packets is to disconnect the device from the phone and reconnect after you have paired it for the first time. (The easiest way to do this in Android is simply to disable Bluetooth after you first paired, and enable it again. Double check the log from the kit to make sure it disconnects and reconnects.)

After you have connected for the second time the system attributes should be properly set, and you should be able to send packets without the error occurring.

Best regards
Torbjørn

RE: is multi touch HID possible with nrf51822 chip?

akash naidu — Fri, 02 Nov 2018 13:55:40 GMT

Hi Ovrebekk

I am using IAR C/C++ Compiler for ARM

Redmi notepad 2.

RE: is multi touch HID possible with nrf51822 chip?

ovrebekk — Fri, 02 Nov 2018 10:01:06 GMT

Hi Akash

What compiler are you using?

Which Android phone are you testing on?

Best regards
Torbjørn

RE: is multi touch HID possible with nrf51822 chip?

akash naidu — Fri, 02 Nov 2018 06:02:35 GMT

Hi Ovrebekk

Thanks for sharing SDK version.

When i have downloaded and test it on nrf52DK, i am getting following logs...

<info> app: HID Mouse example started.
<info> app: m_whitelist_peer_cnt 1, MAX_PEERS_WLIST 8
<info> app: Fast advertising.
<info> app: Connected
<error> app: Fatal error
<warning> app: System reset

Once connection has been established with Android mobile, then i am pressing button 4 for sending report.

When i have pressed Button 4, was getting Fatal error.

I have edited mouse example.

could you please tell me what i have done wrongly?

Best Regards,

Akash

RE: is multi touch HID possible with nrf51822 chip?

ovrebekk — Thu, 01 Nov 2018 16:03:51 GMT

Hi Akash

Sorry about that, I should probably have shared the SDK version with you ;)

I used the latest one, SDK v15.2.0.

Best regards
Torbjørn

RE: is multi touch HID possible with nrf51822 chip?

akash naidu — Wed, 31 Oct 2018 06:01:43 GMT

Hi Ovrebekk

Thanks for sharing the file.

yes, i have nrf52DK and will test on it.

On which SDK you have used to implement the project?

if you share SDK version, so that i can download and edit the main file.Because i am using nRF5_SDK_15.0.0.

Best regards

Akash

RE: is multi touch HID possible with nrf51822 chip?

ovrebekk — Tue, 30 Oct 2018 09:46:53 GMT

My HID descriptor is almost identical to the one you sent, except there is a slight change around the scan time usage. The ordering of lines was a bit non standard in your version (if you compare the two I am sure you will spot it).

You will find the example attached:
ble_app_hids_mouse.zip

Unfortunately I tested this on the nRF52832, not the nRF51822.

Would you happen to have an nRF52DK available that you can test on?

If not I will try to port the code to the nRF51 so you can test it there.

I don't expect the HID behavior to be different on the nRF52 compared to the nRF51, as long as the BLE connection works as normal.

Best regards
Torbjørn

RE: is multi touch HID possible with nrf51822 chip?

akash naidu — Mon, 29 Oct 2018 12:52:00 GMT

Hi Ovrebekk

That was good news.

At least multi touch has been working on Android mobile.

are u using same multi touch hid which i have shared to you?

If possible please share your entire project, so that i can test and will try it work on windows as well.

Best regards,

akash.