diff options
| author | Nathan Bailey <nathan.bailey@arm.com> | 2024-04-15 15:34:03 +0100 |
|---|---|---|
| committer | Nathan Bailey <nathan.bailey@arm.com> | 2024-05-08 12:15:48 +0000 |
| commit | 198ba5eed95677ddb9d1e8c4119062dd3412510a (patch) | |
| tree | c37154ab0a30a0c76c8ad275aae8ee4e40e2a1b2 /README.md | |
| parent | 0999ba0f4381ce1e2e8b06a932bfe693692223e2 (diff) | |
| download | mlia-198ba5eed95677ddb9d1e8c4119062dd3412510a.tar.gz | |
feat: Enables augmentations via --optimization-profile
- Enables user to specify augmentations via the --optimization-profile switch
- Can specify from pre-given examples or can provide each parameter manually
- Updates README
Resolves: MLIA-1147
Signed-off-by: Nathan Bailey <nathan.bailey@arm.com>
Change-Id: I9cbe71d85def6a8db9dc974adc4bcc8d90625505
Diffstat (limited to 'README.md')
| -rw-r--r-- | README.md | 23 |
1 files changed, 20 insertions, 3 deletions
@@ -215,9 +215,26 @@ Training parameters for rewrites can be specified. There are a number of predefined profiles: -| Name | Batch Size | LR | Show Progress | Steps | LR Schedule | Num Procs | Num Threads | Checkpoints | -| :----------: | :--------: | :--: | :-----------: | :---: | :---------: | :-------: | :---------: | :---------: | -| optimization | 32 | 1e-3 | True | 48000 | "cosine" | 1 | 0 | None | +| Name | Batch Size | LR | Show Progress | Steps | LR Schedule | Num Procs | Num Threads | Checkpoints | Augmentations | +| :----------: | :--------: | :--: | :-----------: | :---: | :---------: | :-------: | :---------: | :---------: | :-------------: | +| optimization | 32 | 1e-3 | True | 48000 | "cosine" | 1 | 0 | None | "gaussian" | + +| Name | Batch Size | LR | Show Progress | Steps | LR Schedule | Num Procs | Num Threads | Checkpoints | Augmentations - gaussian_strength | Augmentations - mixup_strength | +| :------------------------------: | :--------: | :--: | :-----------: | :---: | :---------: | :-------: | :---------: | :---------: | :-------------------------------: | :----------------------------: | +| optimization_custom_augmentation | 32 | 1e-3 | True | 48000 | "cosine" | 1 | 0 | None | 0.1 | 0.1 | + +The augmentations consist of 2 parameters: mixup strength and gaussian strength. + +Augmenations can be selected from a number of pre-defined profiles (see the table below) or each individual parameter can be chosen (see optimization_custom_augmentation above for an example): + +| Name | MixUp Strength | Gaussian Strength | +| :------------------: | :------------: | :---------------: | +| "none" | None | None | +| "gaussian" | None | 1.0 | +| "mixup" | 1.0 | None | +| "mixout" | 1.6 | None | +| "mix_gaussian_large" | 2.0 | 1.0 | +| "mix_gaussian_small" | 1.6 | 0.3 | ```bash ##### An example for using optimization Profiles |