MQTT-bridge-mosquitto not working with AWS Iot

RE: MQTT-bridge-mosquitto not working with AWS Iot

dejans — Tue, 04 Feb 2025 10:41:40 GMT

Hi,

The issue in MQTT bridge should be fixed now. Fixed mqtt bridge mosquitto is available in the same location as it was previously. For re-deploying the bridge, you should follow the instructions provided in MQTT bridge mosquitto, get and compile the newest code, and use the --reset option to create a new MQTT Team device and new local credentials as described on the linked page. If this works, then you do not need a workaround anymore. You can also delete all account-* and mqtt-team-* devices on your team that you do not use, except mqtt-team-* device that will be newly created by your latest deployment. That device ID can be found in AWS Systems Manager Parameter Store in the parameter NrfCloudMqttTeamDeviceId.

Best regards,
Dejan

RE: MQTT-bridge-mosquitto not working with AWS Iot

dejans — Wed, 29 Jan 2025 11:09:55 GMT

Hi,

We have tested internally using your config and certificate files and could not reproduce the issue.
Below are some updated instructions. Can you please try again by following instructions shown below?

1. In your AWS account and region where the MQTT Bridge is installed, go to the Systems Manager Parameter Store console.

2. Copy the certificates in the IotCert and IotKey parameters into files named local_IotCert.txt and local_IotKey.txt. Ensure the last line of each file has an end-of-line character at the end.

3. Using the REST API, create an MQTT Team device. See nRF Cloud REST API documentation

4. Store the 3 certificates returned in files named nrfcloud_caCert.txt, nrfcloud_clientCert.txt, and nrfcloud_privateKey.txt.

5. Change all literal strings "\n" to end-of-line characters in all 3 files. Ensure the last line of each file has an end-of-line character at the end.

6. Download mosquitto.org/.../mosquitto-2.0.11-install-windows-x64.exe

7. Install it to the default location

8. Add "%ProgramFiles%\Mosquitto" (without quotes) to the Windows PATH

9. Create a directory from where you will run Mosquitto and store configuration files, such as "C:\Mosquitto".

10. Open a Command Prompt window and "cd" to the run directory you created.

11. Enter "mosquitto -h". You should see the help page and "mosquitto version 2.0.11" displayed.

12. Copy the attached "config.txt" into that directory.

13. Look for the “# Replace…” comment lines and replace the example strings with the correct strings for your case.

14. Create a subdirectory "config".

15. Copy the 5 files you created above, into that "config" directory. (local_IotCert.txt, local_IotKey.txt, nrfcloud_ca.crt, nrfcloud_clientCert.txt, nrfcloud_privateKey.txt)

16. In the run directory, start the mosquitto broker with the command: "mosquitto -v -c config.txt".

17. Verify that MQTT messages sent by devices in your nrfcloud team appear on your AWS account and region on the MQTT topics "data/#" as described in republished topics documentation.

Please find uploaded revised devzone.nordicsemi.com/.../config.txt

If you still experience issue, please consider trying on another computer and look thoroughly for any potential networking issue which may block some traffic.

Best regards,
Dejan

RE: MQTT-bridge-mosquitto not working with AWS Iot

Neel Patel — Wed, 29 Jan 2025 06:02:36 GMT

Hi,

While using this config file, we are facing the below error.

Client nrfcloud-bridge-local disconnected: protocol error.
Client local.DESKTOP-UQS9RRA.iot-bridge disconnected: protocol error.

RE: MQTT-bridge-mosquitto not working with AWS Iot

dejans — Mon, 27 Jan 2025 10:58:28 GMT

Hi Neel,

Have you made any progress? Can you provide an update on a current status?

Best regards,
Dejan

RE: MQTT-bridge-mosquitto not working with AWS Iot

dejans — Mon, 20 Jan 2025 12:22:41 GMT

Hi Neel,

Although there is no fix for MQTT Bridge yet, we have verified that mosquitto MQTT broker (which the bridge uses) works if it is installed and configured manually.

Fortunately, there is a workaround implementation which you can try to follow. It installs and configures Mosquitto locally on a Windows 11 machine. You can adapt these instructions for use on Linux or in Docker containers as you see fit.

The MQTT Bridge must be already installed, because it reuses local certs the bridge creates. The ECS task of the bridge does need to be running. You can stop it using the AWS Console by clicking “Update Service” on the ECS cluster’s nrfcloud-mqtt-bridge-MqttBridgeService…, and setting the “Desired tasks” to 0.

In your AWS account and region where the MQTT Bridge is installed, go to the Systems Manager Parameter Store console.

Copy the certificates in the IotCert and IotKey parameters into files named local_IotCert.txt and local_IotKey.txt. Ensure the last line of each file has an end-of-line character at the end.

Using the REST API, create an MQTT Team device. See https://api.nrfcloud.com/v1#tag/Mqtt-Team-Devices/operation/CreateMqttTeamDevice.

Store the 3 certificates returned in files named nrfcloud_caCert.crt, nrfcloud_clientCert.txt, and nrfcloud_privateKey.txt.

Change all literal strings "\n" to end-of-line characters in all 3 files. Ensure the last line of each file has an end-of-line character at the end.

Download https://mosquitto.org/files/binary/win64/mosquitto-2.0.11-install-windows-x64.exe

Install it to the default location

Add "%ProgramFiles%\Mosquitto" (without quotes) to the Windows PATH

Create a directory from where you will run Mosquitto and store configuration files, such as "C:\Mosquitto".
Open a Command Prompt window and "cd" to the run directory you created.
Enter "mosquitto -h". You should see the help page and "mosquitto version 2.0.11" displayed.
Copy the attached "config.txt" into that directory.
Replace the "remote_clientid" with the ID of the MQTT Team device you created, e.g. "mqtt-team-…".
Replace the "address" of the "connection iot-bridge" (not the "connection nrfcloud-bridge") with the AWS IoT Domain configuration name for your AWS account and region.
Create a subdirectory "config".
Copy the 5 files you created above, into that "config" directory. (local_IotCert.txt, local_IotKey.txt, nrfcloud_ca.crt, nrfcloud_clientCert.txt, nrfcloud_privateKey.txt)
In the run directory, start the mosquitto broker with the command: "mosquitto -v -c config.txt".
Verify that MQTT messages sent by devices in your nrfCloud team appear on your AWS account and region on the MQTT topics "data/#" as described in republished topics.

Please find uploaded example of config.txt file. devzone.nordicsemi.com/.../1638.config.txt

Best regards,
Dejan

RE: MQTT-bridge-mosquitto not working with AWS Iot

Neel Patel — Fri, 17 Jan 2025 06:11:34 GMT

Hi,
Is there any update here? We are in a bit hurry as production system is impaired by this.
Thanks in advance.

Regards,
Neel

RE: MQTT-bridge-mosquitto not working with AWS Iot

dejans — Wed, 15 Jan 2025 13:33:10 GMT

Hi,

I have reached out again to the relevant team internally. I will get back to you with status update by the end of this week.

Best regards,
Dejan

RE: MQTT-bridge-mosquitto not working with AWS Iot

Eirik Aa — Mon, 13 Jan 2025 10:20:13 GMT

It would be nice to get some feedback on this cause this is stopping everything.

RE: MQTT-bridge-mosquitto not working with AWS Iot

dejans — Fri, 10 Jan 2025 15:09:24 GMT

Hi,

I have reported this problem internally. I will get back to you by the end of next week.
In the meantime, please let me know if situation changes and you start getting data in AWS.

Best regards,
Dejan

RE: MQTT-bridge-mosquitto not working with AWS Iot

Neel Patel — Thu, 09 Jan 2025 13:40:08 GMT

Hi,

Earlier it was working fine then it suddenly stopped. So we recreated the mosquito bridge but it didn’t work
We are getting data in nRF cloud but not in aws IoT

Thanks

RE: MQTT-bridge-mosquitto not working with AWS Iot

dejans — Thu, 09 Jan 2025 10:28:05 GMT

Hi,

Which board do you use?

Did you get data at any point after the issue appeared for the first time or does the sequence "Connecting -> Closed its connection" persist?

Best regards,
Dejan

RE: MQTT-bridge-mosquitto not working with AWS Iot

Neel Patel — Wed, 08 Jan 2025 06:14:25 GMT

Hi,

We have 50+ devices and all devices are not able to connect. Our devices are in 2-3 countries like Poland, Spain etc.

Thanks

RE: MQTT-bridge-mosquitto not working with AWS Iot

dejans — Tue, 07 Jan 2025 13:52:32 GMT

Hi,

How many devices do you have in total? How many devices are affected by this "not able to connect" problem?

Are affected devices (that try to connect) located in the same physical location?

Best regards,
Dejan