FDS no swap page

RE: FDS no swap page

Ray Ma — Wed, 11 Nov 2020 18:49:42 GMT

I don't have a way to repro this so I end up implementing the patch, so far it seems working fine.

RE: FDS no swap page

Edvin — Mon, 02 Nov 2020 07:42:26 GMT

Sorry. Yes, you are correct. I was reading from the release notes from SDK17.0.0, but the snippet I pasted in my previous reply was from the section "nRF5 SDK v16.0.0" from the 17.0.0 release notes.

Do you have a reliable way to reproduce this issue? Do you call fds_gc() in your initialize procedure? (during the startup of your application?)

RE: FDS no swap page

Ray Ma — Fri, 30 Oct 2020 18:50:35 GMT

Hey Edvin,

I downloaded the SDK17 and turns out the FDS code is exactly the same as in SDK16, looks like the fixes you mentioned are already in SDK16.

-Ray

RE: FDS no swap page

Edvin — Fri, 30 Oct 2020 08:09:36 GMT

In theory it could, but it is hard to say without knowing what causes it.

From the release notes in SDK17.0.0:

*** Bug fixes
****************

** Drivers and libraries **

- FDS: fixed two bugs where a power loss at very specific times during garbage
  collection could corrupt the file system, making FDS unable to initialize and return
  FDS_ERR_NO_PAGES on initialization.
- FDS: fixed a bug that prevented using the last word of a flash page to save a record.
...

The first one, which could cause FDS_ERROR_NO_PAGES is the one that can also cause FDS_VIRTUAL_PAGES, depening on which and how many pages that are corrupted so I would recommend porting to at least SDK17 if you experience FDS issues. While you are at it, SDK17.0.0 and SDK17.0.2 are basically the same from an API perspective. And it is almost the same as SDK16 as well, so it will not be much work porting from SDK16 to 17.0.2. It would also be possible to only port the FDS to the latest SDK, if porting is too much work.

The patch I mentioned is not something we have implemented officially, but it would consist of identifying what page that is corrupted, erasing it and run fds_init() again. Alternatively, a soft reset instead of fds_init(). fds_init() will take care of the rest if the page is completely blank, and it doesn't have a swap page.

Best regards,

Edvin

RE: FDS no swap page

Ray Ma — Fri, 30 Oct 2020 02:19:07 GMT

Hey Edvin,

Thanks for the response. I am not sure if I can replicate this since I only saw the issue one. Do you think a soft reset or watchdog reset during GC would also trigger this issue?

Regarding Therefore you should only call fds_gc() when you receive an event saying that it is needed. which event should I be looking for to start GC?

Another interesting behavior I found out is that If I set FDS_VIRTUAL_PAGES to 4 instead of 3, one of my fds_write will never trigger the fds_event_handler that I've registered. I have confirmed there is enough FLASH space for the allocation, and I did see 4 pages been initialized in the fds_stat. I am wondering if this is caused by the internal m_fs_event_handler not getting called(I am not sure how does it get called), any idea or suggestion for me to debug this?

Thanks,

-Ray

RE: FDS no swap page

Edvin — Thu, 29 Oct 2020 15:23:42 GMT

Hello,

Do you have a solid way of replicating this? Have you tried to use SDK17.0.2? There have been some FDS patches in the later SDKs. Try that, and see if it works.

If not, do I would be very interrested in trying to replicate this, if you have a method that can replicate the issue persistently.

One thing that you can check:

Do not call fds_gc() on startup. This should only be called when the FDS is full. The reason for this is that most cases we have seen when this occurs, it is due to bugs in the fds_gc(), when power is being cut during this process.

If you run the device on battery, and it is starting to run out of power, it will switch on and off frequently, and possibly for a long time. If this happens, the risk of bugs are higher. Therefore you should only call fds_gc() when you receive an event saying that it is needed.

We have found some causes for this bug, but there may be more, so please let me know if you can recreate it persistently.

This can, however be patched in the case where the missing swap page is empty (almost empty). As long as it doesn't contain any records, it should be safe to erase the page and manually write the magic page tag and the swap page tag.

Best regards,

Edvin