User Tools

Site Tools


pipeline:window:cryolo:configuration

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
pipeline:window:cryolo:configuration [2019/09/17 10:29]
twagner
pipeline:window:cryolo:configuration [2020/03/16 15:20] (current)
twagner
Line 1: Line 1:
-====%hide Basic==== +You now have to create a configuration file for your picking project. It contains all important constants and paths and helps you to reproduce your results later on. 
-You now have to create a configuration file your picking project. It contains all important constants and paths and helps you to reproduce your results later on. +
  
 You can either use the command line to create the configuration file or the GUI. For most users, the GUI should be easier. Select the //config// action and fill in the general fields: You can either use the command line to create the configuration file or the GUI. For most users, the GUI should be easier. Select the //config// action and fill in the general fields:
  
-{{ :pipeline:window:cryolo:cryolo_configuration_01.png?700 |}} +{{ :pipeline:window:cryolo:cryolo_configuration_01_202003.png?700 |}} 
-<note> + 
-You could already press the Start button to generate the config file but you might want to take these options into account:+At this point you could already press the [Startbutton to generate the config file but you might want to take these options into account: 
 + 
 +  * During training, crYOLO also needs validation data((Micrographs that are selected as validation data are not used to train crYOLO. These micrographs are used to calculate how well the model performs and whether it still improves.)). Typically, 20% of the training data are randomly chosen as validation data. If you want to use specific images as validation data, you can move the images and the corresponding box files to separate folders. __Make sure that they are removed from the original training folder!__ You can then specify the new validation folders in //"Validation configuration"// tab. 
 +  * By default, your micrographs are low pass filtered to an absolute frequency of 0.1 and saved to disk. You can change the cutoff threshold and the directory for filtered micrographs in the //"Denoising options"// tab.  
 +  * When training from scratch, crYOLO is initialized with weights learned on the ImageNet training data (transfer learning((From Wikipedia: Transfer learning (TL) is a research problem in machine learning (ML) that focuses on storing knowledge gained while solving one problem and applying it to a different but related problem.))). However, it might improve the training if you set the pretrained_weights options in the //"Training options"// tab to the current general model. Please note, doing this you don't fine tune the network, you just change the initial model initialization.
  
-  * During training, crYOLO also needs validation data. Typically, 20% of the training data are randomly chosen as validation data. If you want to use specific images as validation data, you can move the images and the corresponding box files to separate folders. Make sure that they are removed from the original training folder! You can then specify the new validation folders in //"Validation configuration"// tab. 
-  * By default, your images are low pass filtered to absolute frequency of 0.1 and saved to disk. You can change the cutoff threshold and the directory for filtered images in the //"Model/Denoising options"// tab.  
-</note> 
 <note tip> <note tip>
 **Alternative: Using neural-network denoising with JANNI** **Alternative: Using neural-network denoising with JANNI**
  
-Since crYOLO 1.4 you can also use neural network denoising with [[:janni|JANNI]]. The easiest way is to use the JANNI's general model ([[:janni#janni_general_model|Download here]]) but you can also [[:janni_tutorial#training_a_model_for_your_data|train JANNI for your data]]. crYOLO directly uses an interface to JANNI to filter your data, you just have to change the filter argument in the //Model/Denoising tab// from LOWPASS to JANNI and specify the path to your JANNI model:+Since crYOLO 1.4 you can also use neural network denoising with [[:janni|JANNI]]. The easiest way is to use the JANNI's general model ([[:janni#janni_general_model|Download here]]) but you can also [[:janni_tutorial#training_a_model_for_your_data|train JANNI for your data]]. crYOLO directly uses an interface to JANNI to filter your data, you just have to change the filter argument in the //Denoising tab// from LOWPASS to JANNI and specify the path to your JANNI model:
 {{ :pipeline:window:cryolo:cryolo_configuration_02.png?300 |}} {{ :pipeline:window:cryolo:cryolo_configuration_02.png?300 |}}
 I recommend to use denoising with JANNI only together with a GPU as it is rather slow (~ 1-2 seconds per micrograph on the GPU and 10 seconds per micrograph on the CPU) I recommend to use denoising with JANNI only together with a GPU as it is rather slow (~ 1-2 seconds per micrograph on the GPU and 10 seconds per micrograph on the CPU)
Line 20: Line 20:
 </note> </note>
 <note tip> <note tip>
-You can also modify all options and parameters directly in the config.json file. Please note the wiki entry about the [[:cryolo_config|crYOLO configuration file]] if you want to know more details.+**Editing the configuration file** 
 + 
 +You can also modify all options and parameters directly in the config.json file. It can be opened by any text editor. Please note the wiki entry about the [[:cryolo_config|crYOLO configuration file]] if you want to know more details.
 </note> </note>
-====%hide Basic_End ==== 
-  
-====%hide CLnormal==== 
-<hidden **Create the configuration file using the command line:**> 
- 
-To create a basic configuration file that will work for most projects is very simple. I assume your box files for training are in the folder ''train_annotation'' and the corresponding images in ''train_image''. I furthermore assume that your box size in your box files is 160. To create the config config_cryolo.json simply run: 
- 
-<code> 
-cryoloo.py config config_cryolo.json 160 --train_image_folder train_image --train_annot_folder train_annot 
-</code> 
- 
-To get a full description of all available options type: 
-<code> 
-cryoloo.py config -h 
-</code> 
- 
-//[[:cryolo_config|Click here to get more information about the configuration file]]// 
- 
-If you want to specify seperate validation folders you can use the %%--%%valid_image_folder and %%--%%valid_annot_folder options: 
- 
-<code> 
-cryoloo.py config config_cryolo.json 160 --train_image_folder train_image --train_annot_folder train_annot --valid_image_folder valid_img --valid_annot_folder valid_annot 
-</code> 
- 
-</hidden> 
-====%hide CLnormal_end ==== 
pipeline/window/cryolo/configuration.txt · Last modified: 2020/03/16 15:20 by twagner