Commit
·
d559c9e
1
Parent(s):
a603ea7
Update ReadMe
Browse files
README.md
CHANGED
@@ -73,7 +73,7 @@ model = BACKBONE_REGISTRY.build(
|
|
73 |
)
|
74 |
```
|
75 |
|
76 |
-
The model supports the following raw inputs which you can specify in modalities
|
77 |
If your data does not use all bands of a modality, you can specify a subset with `bands={'S2L2A': ['BLUE', 'GREEN', 'RED', 'NIR_NARROW', 'SWIR_1', 'SWIR_2']}`.
|
78 |
You can pass the inputs as in a dict to the model. If a tensor is directly passed, the model assumes it is the first defined modality.
|
79 |
TerraMind can also handle missing input modalities.
|
@@ -131,12 +131,13 @@ model = FULL_MODEL_REGISTRY.build(
|
|
131 |
modalities=['S2L2A'],
|
132 |
output_modalities=['S1GRD', 'LULC'],
|
133 |
timesteps=10, # Define diffusion steps
|
134 |
-
standardize=True, #
|
135 |
)
|
136 |
```
|
137 |
-
Like the backbone, pass multiple modalities as a dict or a single modality as a tensor to the model which returns generated
|
138 |
Note: These generations are not reconstructions but "mental images" representing how the model imagines the modality.
|
139 |
You can control generation details via the number of diffusion steps (`timesteps`) that you can pass to the constructor or the forward function.
|
|
|
140 |
|
141 |
We provide an example notebook for generations at https://github.com/IBM/terramind.
|
142 |
|
|
|
73 |
)
|
74 |
```
|
75 |
|
76 |
+
The model supports the following raw inputs which you can specify in `modalities`: S2L2A, S2L1C, S1GRD, S1RTC, DEM, RGB.
|
77 |
If your data does not use all bands of a modality, you can specify a subset with `bands={'S2L2A': ['BLUE', 'GREEN', 'RED', 'NIR_NARROW', 'SWIR_1', 'SWIR_2']}`.
|
78 |
You can pass the inputs as in a dict to the model. If a tensor is directly passed, the model assumes it is the first defined modality.
|
79 |
TerraMind can also handle missing input modalities.
|
|
|
131 |
modalities=['S2L2A'],
|
132 |
output_modalities=['S1GRD', 'LULC'],
|
133 |
timesteps=10, # Define diffusion steps
|
134 |
+
standardize=True, # Apply standardization
|
135 |
)
|
136 |
```
|
137 |
+
Like the backbone, pass multiple modalities as a dict or a single modality as a tensor to the model which returns the generated `output_modalities` as a dict of tensors.
|
138 |
Note: These generations are not reconstructions but "mental images" representing how the model imagines the modality.
|
139 |
You can control generation details via the number of diffusion steps (`timesteps`) that you can pass to the constructor or the forward function.
|
140 |
+
By passing `standardize=True`, the pre-training standardization values are automatically applied to the input and output.
|
141 |
|
142 |
We provide an example notebook for generations at https://github.com/IBM/terramind.
|
143 |
|