are we going to support opennmmlab package in flower examples

[cam-ai]

Describe the type of feature and its functionality.

are we going to support to opennmmlab in future, it is hard for you to get a simple Net(nn.module) in openmmlab,

Describe step by step what files and adjustments are you planning to include.

need some examples for openmmlab usage

Is there something else you want to add?

openmmlab like mmdet or mmdet3d

[adam-narozniak]

Just to clarify, you're requesting an example with open-mmlab e.g. the mmdetection library?

[cam-ai]

Yes, you create fl-client, and this client will call mmdetection to build up model, prepare related data loader, then you can train the model with flower

[cam-ai]

mmdetection depends on the mmengine, but in mmengine, how could you intergrate the fl client with mmengin.runner.run()

[jafermarq]

Hi @cam-ai , it should be possible. I'm not familiar with that library but typically you can think of the training stage of each client as a mini-centralised training (only with the data the client owns). This means that it is possible to make use of any training library or training loop design and call it from the client's fit(). There is a Flower Baseline (FedVSSL) that uses it. Please take a look. I note it wasn't the easiest package to integrate, but maybe @yan-gao-GY can give you some tips since he wrote that baseline.

[cam-ai]

it is close. but i still can not find how did the server control the client learning rate, at least there should be a learning rate callback to adjust learning with epochs, cause everything is encapsulated in mmengine.runner.run()