SPHIRE Workflow
Sidebar
pipeline:window:cryolo:picking_general
This version (2020/06/05 09:03) was approved by twagner.The Previously approved version (2020/05/25 10:14) is available.
Table of Contents
DOCUMENTATION OUTDATED
The documentation has moved to https://cryolo.readthedocs.io
Picking particles - Without training using a general model
Here you can find how to apply the general models we trained for you. If you would like to train your own general model, please see our extra wiki page: How to train your own general model.
Our general models can be found and downloaded here: Download and Installation.
If you followed the installation instructions, you now have to activate the cryolo virtual environment with
source activate cryolo
1. Start crYOLO
You can use crYOLO either by command line or by using the GUI. The GUI should be easier for most users. You can start it with:
cryolo_gui.py
The crYOLO GUI is essentially a visualization of the command line interface. On left side, you find all possible “Actions”:
- config: With this action you create the configuration file that you need to run crYOLO.
- train: This action lets you train crYOLO from scratch or refine an existing model.
- predict: If you have a (pre)trained model you can pick particles in your data set using this command.
- evaluation: This action helps you to quantify the quality of your model.
- boxmanager: This action starts the cryolo boxmanager. You can visulize the picked particles with it or create training data.
Each action has several parameters which are organized in tabs. Once you have chosen your settings you can press [Start] (just as example, don't press it now 
), the command will be applied and crYOLO shows you the output:
It will tell you if something went wrong. Moreover, it will tell you all parameters used. Pressing [Back] brings you back to your settings, where you can either edit the settings (in case something went wrong) or go to the next action.
2. Configuration
In the GUI choose the config action. Fill in your target box size and leave the train_image_folder and train_annot_folder fields empty.
There are three general models available. It is important that you choose the same filtering options in “Denoising options” tab as we did during training the general models. In the following are the filtering settings that we used for the respective general models:
- General model trained for low-pass filtered images : Select filter “LOWPASS” and low_pass_cutoff of 0.1
- General model trained for JANNI-denoised images: Select filter “JANNI” and the janni general model for janni_model. Keep the defaults for janni_overlap and janni_batches
- General model for negative stain images: Select filter “NONE”
Anchor size is optional
In the configuration file, the field “anchors” is optional during prediction. That means, you don't to define a box size during prediction, as crYOLO does a size estimation internally. This is of advantage for automated pipelines. You can simply delete the entry in configuration file. This should not affect the picking quality. The estimated size is still contained in .cbox files. Coordinates in EMAN and STAR format are written with a box size of 0 in that case.
► Press the [Start] button to write the configuration file to disk.
Alternative: Create the configuration file using the command line
3. Picking
Select the action “predict” and fill all arguments in the “Required arguments” tab:
Adjusting confidence threshold
In crYOLO, all particles have an assigned confidence value. By default, all particles with a confidence value below 0.3 are discarded. If you want to pick less or more conservatively you might want to change this confidence threshold to a less (e.g. 0.2) or more (e.g. 0.4) conservative value in the “Optional arguments” tab.
However, it is much easier to select the best threshold after picking using the CBOX files written by crYOLO as described in the next section.
Monitor mode
When this option is activated, crYOLO will monitor your input folder. This especially useful for automation purposes. You can stop the monitor mode by writing an empty file with the name “stop.cryolo” in the input directory. Just add –monitor in the command line or check the monitor box in in the “Optional arguments” tab.
After picking is done, you can find four folders in your specified output folder:
- CBOX: Contains a coordinate file in .cbox format each input micrograph. It contains all detected particles, even those with a confidence lower the selected confidence threshold. Additionally it contains the confidence and the estimated diameter for each particle. Importing those files into the boxmanager allows you advanced filtering e.g. according size or confidence.
- EMAN: Contains a coordinate file in .box format each input micrograph. Only particles with the an confidence higher then the selected (default: 0.3) are contained in those files.
- STAR: Contains a coordinate file in .star format each input micrograph. Only particles with the an confidence higher then the selected (default: 0.3) are contained in those files.
- DISTR: Contains the plots of confidence- and size-distribution. Moroever, it contains a machine readable text-file the summary statistics about these distributions and their raw data in separate text-files.
► Press the the [Start] button to run the prediction.
Alternative: Run prediction from the command line
4. Visualize the results
To visualize your results you can use the boxmanager:
As image_dir you select the full_data directory. As box_dir you select the CBOX folder (or EMAN_HELIX_SEGMENTED in case of filaments).
The following does not yet work for filaments.
CBOX files contain besides the particle coordinates more information like the confidence and the estimated size of each particle. When importing .cbox files into the box manager, it enables more filtering options in the GUI. You can plot size- and confidence distributions. Moreover, you can change the confidence threshold, minimum and maximum size and see the results in a live preview. If you are done with the filtering, you can then write the new box selection into new box files. The video below shows an example.
pipeline/window/cryolo/picking_general.txt · Last modified: 2020/06/05 09:03 by twagner
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: GNU Free Documentation License 1.3
