Parsing sensor data to a JSON file through MQTT Broker

[Adeel]

Hi Dev team,

I am working on a nrf9160DK and transmitting my sensor data to a MQTT Client. I tested this through an application : MQTT.fx (Using mqtt.eclipse.org as open source broker) and I was able to get my data published.

Now, I need to parse my sensor data to a JSON file using the same broker : mqtt.eclipse.org on topic : my/publish/topic.

I have attached the JSON file where my data needs to be passed.

8867.config.rar

I would like to know the steps that would be required to parse data from my code to a JSON file.

I used the mqtt_simple client example in NCS v1.3.0 to publish the data outside. Can it be modified to parse the data to a JSON file.

Regards,

Adeel.

[JONATHAN LL]

Hi, 

my/publish/topic.

 I would advise to not use the default topics and topic structure in the final project as it may end up getting random test data from anyone. Add some extra label or rename something.


I have not used MQTT.FX so i cant really give propper feedback on that. Here is a link to a different solution that might be equally helpful using python. 

I would like to know the steps that would be required to parse data from my code to a JSON file.

 Do you mean on the nrf9160 or on the MQTT.FX side? Do you intend to store JSON files on the nrf9160 or are you takling about putting sensor data in to a JSON format?


A proposed solution based on initial understanding of the question:
- Take measurement
- Send as MQTT message to broker Use another client (such as MQTT.fx) to receive the message
- Take the necessary information from the MQTT payload
- Pass this information to a function that generates your JSON file

The last two steps i assume can be done in MQTT.fx


Take a look this example, it includes a more complex solution that uses JSON. There has been som changes in the newer version v1.4.0 that improves the example so might be smart to look at latest release tag. 

What is the end goal? Do you intend to use a desktop/phone application to view sensors?

Here is a link to a guide using AWS Cloud solution, it might be of interest. 

Regards,
Jonathan

[Adeel]

Hi Jonathon,

Thanks for the detailed reply . Gave me a lot of insight.

I was actually looking to write my sensor data to this JSON file through the nrf9160dk example.

config.rar

The JSON has a mqtt field : 

"mqtt": {
"host": "mqtt.eclipse.org",
"port": 1883,
"topic": "my/publish/topic"

through which I want to identify the broker to which I am sending the data.

After that, I just want to add my data by creating a value tag for a sensor.

So, as a first step, I wanted to know as to how to create this type of JSON file through C that I could through SES.

Also, how to write values into this kind of a file.

Regards,

Adeel.

[Adeel]

Hi Jonathon,

I was progressing with this and I found a cjson library in the nrf folder : C:\Users\adeel\ncs\v1.3.0\nrf\ext\cjson

It contains the cJSON.c and cJSON.h file. 

Can this library file be used to generate a JSON file of its own ? Then I can create a file and add my fields in the same file. 

Regards,

Adeel.

[JONATHAN LL]

Hi Adeel,


It is not a file like in a file system file, it is a object witch you can store data in. You can follow the examples in aws_iot(link to use here) and asset_tracker (link to use in assetracker) to see how it is used to for with JSON in C. If you want your own file that contains JSON data and want to read and write to that file then you need to use a file system. 

Here is the link to the documentation for cJSON. I recommend reading this, the implementation used in the aws_iot and asset_tracker examples are a bit much to get into at first.

Here is a similar case on Devzone: Mqtt simple nrf9160, send JSON as utf-8 - Nordic Q&A - Nordic DevZone - Nordic DevZone (nordicsemi.com) 

If you want a file system then maybe look in to Zephyr RTOS Virtual Filesystem Switch (VFS) , but i dont hink that it is needed if i understand your use case correctly.

Regards,
Jonathan

[Adeel]

Hi Jonathon,

Okay, now I get your point. Yes, I think I don't need a file system. 

I will study the cJSON library and try to send my data out through it. 

1 question regarding my existing JSON file that I linked above:

It has an mqtt field : 

"mqtt": {
"host": "mqtt.eclipse.org",
"port": 1883,
"topic": "my/publish/topic"

Is this field enough for the board to recognise this broker and send the data to this file.

I know its a naive question, but I have never worked with file systems as such :). Just worked with inbuilt software's so was not sure if the writing happens in this way.

Regards,

Adeel.