This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
pipeline:utilities:sxpipe_moon_eliminator [2018/08/06 14:26] moriya |
pipeline:utilities:sxpipe_moon_eliminator [2019/04/02 10:42] lusnig [See also] |
||
---|---|---|---|
Line 1: | Line 1: | ||
~~NOTOC~~ | ~~NOTOC~~ | ||
- | ===== sxpipe | + | ===== sp_pipe |
- | Moon eliminator: Eliminate moons or remove dusts from the background of a 3D density map based on the expected molecular mass. Optionally, create 3D mask also. | + | Volume Adjustment: Eliminate moons or remove dusts from the background of a 3D density map based on the expected molecular mass. |
\\ | \\ | ||
Line 9: | Line 9: | ||
Usage in command line | Usage in command line | ||
- | | + | |
\\ | \\ | ||
===== Typical usage ===== | ===== Typical usage ===== | ||
- | sxpipe | + | sp_pipe |
There are two modes to run the program: | There are two modes to run the program: | ||
Line 21: | Line 21: | ||
__1. Single Volume Mode:__ | __1. Single Volume Mode:__ | ||
- | Create reference 3D volume | + | Create reference 3D structure |
- | | + | |
- | Create reference 3D volume | + | Create reference 3D structure |
- | | + | |
- | Create reference 3D volume | + | Create reference 3D structure |
- | | + | |
\\ | \\ | ||
__2. Halfset Volumes Mode:__ | __2. Halfset Volumes Mode:__ | ||
- | Create reference 3D volume | + | Create reference 3D structure |
- | | + | |
Line 45: | Line 45: | ||
=== Main Parameters === | === Main Parameters === | ||
; input_volume_path : Input volume path: Path to input volume file containing the 3D density map. (default required string) | ; input_volume_path : Input volume path: Path to input volume file containing the 3D density map. (default required string) | ||
- | | + | ; output_directory : Output directory: The results will be written here. It cannot |
- | | + | |
- | ; %%--%%pixel_size : Output pixel size [A]: The original pixel size of dataset. This must be the pixel size after resampling when resample_ratio != 1.0. That is, it will be the pixel size of the output | + | ; %%--%%pixel_size : Output pixel size [A]: The original pixel size of dataset. This must be the pixel size after resampling when resample_ratio != 1.0. That is, it will be the pixel size of the output |
- | ; %%--%%mol_mass : Molecular mass [kDa]: The estimated molecular mass of the target particle in kilodalton. (default required float) | + | ; %%--%%use_mol_mass : Use molecular mass : GUI OPTION ONLY - Define if one want to use the molecular mass option as a masking threshold. (default False) : %%--%%use_density_threshold==none |
- | ; %%--%%use_density_threshold : Use ad-hoc density threshold: Use user-provided ad-hoc density threshold, instead of computing the value from the molecular mass. Below this density value, the data is assumed not to belong to the main body of the particle density. (default none) | + | ; %%--%%mol_mass : Molecular mass [kDa]: The estimated molecular mass of the target particle in kilodalton. (default required float) |
+ | ; %%--%%use_density_threshold : Use ad-hoc density threshold: Use user-provided ad-hoc density threshold, instead of computing the value from the molecular mass. Below this density value, the data is assumed not to belong to the main body of the particle density. (default none) : %%--%%use_mol_mass==False | ||
; %%--%%moon_distance : Distance to the nearest moon [Pixels]: The moons further than this distance from the density surface will be elminated. The value smaller than the default is not recommended because it is difficult to avoid the stair-like gray level change at the edge of the density surface. (default 3.0) | ; %%--%%moon_distance : Distance to the nearest moon [Pixels]: The moons further than this distance from the density surface will be elminated. The value smaller than the default is not recommended because it is difficult to avoid the stair-like gray level change at the edge of the density surface. (default 3.0) | ||
- | | + | ; %%--%%resample_ratio : Resample ratio: Specify a value larger than 0.0. By default, the program does not resample |
- | ; %%--%%edge_sigma : Edge sigma [Pixels]: The Gaussian sigma of transition area for soft-edge of the moon eliminator 3D mask. This value controls the falloff speed of soft-edge; The samller the sigma, the faster the falloff. Effective only with %%--%%edge_type=' | + | |
- | | + | |
; %%--%%box_size : Output box size [Pixels]: The x, y, and z dimensions of cubic area to be windowed from input 3D volume for output 3D volumes. This must be the box size after resampling when resample_ratio != 1.0. (default none) | ; %%--%%box_size : Output box size [Pixels]: The x, y, and z dimensions of cubic area to be windowed from input 3D volume for output 3D volumes. This must be the box size after resampling when resample_ratio != 1.0. (default none) | ||
- | | + | ; %%--%%invert_handedness : Invert handedness: Invert the handedness of the 3D map. (default False) |
- | ; %%--%%shift3d_x : 3D x-shift [Pixels]: Provide 3D x-shift corresponding to shifting the 3D volume along x-axis. (default 0) | + | |
- | ; %%--%%shift3d_y : 3D y-shift [Pixels]: Provide 3D y-shift corresponding to shifting the 3D volume along y-axis. (default 0) | + | |
- | ; %%--%%shift3d_z : 3D z-shift [Pixels]: Provide 3D z-shift corresponding to shifting the 3D volume along z-axis. (default 0) | + | |
- | | + | |
; %%--%%fl : Low-pass filter resolution [A]: >0.0: low-pass filter to the value in Angstrom; =-1.0: no low-pass filter. The program applies this low-pass filter before the moon elimination. (default -1.0) | ; %%--%%fl : Low-pass filter resolution [A]: >0.0: low-pass filter to the value in Angstrom; =-1.0: no low-pass filter. The program applies this low-pass filter before the moon elimination. (default -1.0) | ||
- | ; %%--%%aa : Low-pass filter fall-off [1/Pixels]: Low-pass filter fall-off in absolute frequency. The program applies this low-pass filter before the moon elimination. Effective only when %%--%%fl > 0.0. (default 0.1) | ||
- | ; %%--%%generate_mask : Generate soft-edged mask: Generate soft-edged mask with specified method from the 3D binary volume corresponding to the specified molecular mass or density threshold, using the values provided through %%--%%gm_* options. Available methods are (1) ' | ||
\\ | \\ | ||
=== Advanced Parameters === | === Advanced Parameters === | ||
- | ; %%--%%gm_dilation | + | |
- | ; %%--%%gm_edge_width | + | |
- | ; %%--%%gm_edge_sigma | + | ; %%--%%edge_width |
+ | ; %%--%%edge_type | ||
; %%--%%outputs_root : Root name of outputs: Specify the root name of all outputs. It cannot be empty string or only white spaces. (default vol3d) | ; %%--%%outputs_root : Root name of outputs: Specify the root name of all outputs. It cannot be empty string or only white spaces. (default vol3d) | ||
- | ; %%--%%allow_disconnect | + | ; %%--%%resampled_shift3d |
- | ; %%--%%edge_type | + | ; %%--%%shift3d_x |
+ | ; %%--%%shift3d_y : 3D y-shift [Pixels]: | ||
+ | ; %%--%%shift3d_z : 3D z-shift [Pixels]: 3D z-shift value. | ||
+ | ; %%--%%aa : Low-pass filter fall-off [1/Pixels]: Low-pass filter fall-off in absolute frequency. The program applies this low-pass filter before the moon elimination. Effective only when %%--%%fl > 0.0. (default | ||
; %%--%%debug : Run with debug mode: Mainly for developer. (default False) | ; %%--%%debug : Run with debug mode: Mainly for developer. (default False) | ||
Line 79: | Line 75: | ||
=== List of output Files === | === List of output Files === | ||
|| **File Name** || **Discription** || | || **File Name** || **Discription** || | ||
+ | || *_ref_before_moon_elimination.hdf || File containing the 3D reference map before moon elimination (i.e., the 3D map just before applying moon elimination.). || | ||
|| *_ref_moon_eliminated.hdf || File containing the moon eliminated 3D reference. || | || *_ref_moon_eliminated.hdf || File containing the moon eliminated 3D reference. || | ||
|| *_mask_moon_elminator.hdf || File containing the moon elminator 3D mask. || | || *_mask_moon_elminator.hdf || File containing the moon elminator 3D mask. || | ||
Line 88: | Line 85: | ||
This command executes the following processes: | This command executes the following processes: | ||
- Extract resample ratio from ISAC run directory if necessary (mainly for R-VIPER models). | - Extract resample ratio from ISAC run directory if necessary (mainly for R-VIPER models). | ||
- | - Resample and window the volume | + | - Resample and window the map if necessary (mainly for R-VIPER models) |
- | - Shift 3D volume | + | - Shift 3D map if necessary. |
- Invert the handedness if necessary. | - Invert the handedness if necessary. | ||
- | - Apply low-pass filter to the input volume | + | - Apply low-pass filter to the input map before the moon elimination if necessary. |
- | - Create reference 3D volume | + | - Save reference 3D map before eliminating the moons. |
- | - Create 3D mask from the 3D bainary | + | - Create reference 3D map by eliminating the moons from the input map and save the results. |
+ | - Create 3D mask from the 3D binary | ||
\\ | \\ | ||
Line 106: | Line 104: | ||
Wish | Wish | ||
- | * Add options for 3D rotation of the volume. | + | * Add options for 3D rotation of the map. |
=== 2018/06/18 Toshio Moriya === | === 2018/06/18 Toshio Moriya === | ||
Line 115: | Line 113: | ||
* If moon_distance is too long, the moons will be connected and creates strange low density shape at the edge of the moon_distance. | * If moon_distance is too long, the moons will be connected and creates strange low density shape at the edge of the moon_distance. | ||
* On the other hand, if it is too short, soft-edge will have the stair-like gray level change because of quantization or digitization. | * On the other hand, if it is too short, soft-edge will have the stair-like gray level change because of quantization or digitization. | ||
- | * dilation | + | * ndilation |
- | * Setting dilation to half of moon_distance generates mask where the voxels with 1.0 values are same as the hard-edged molecular-mass binary | + | * Setting dilation to half of moon_distance generates mask where the voxels with 1.0 values are same as the hard-edged molecular-mass binary |
- | * Setting dilation to smaller than half of moon_distance generates mask where the voxels with 1.0 values are smaller than the hard-edged molecular-mass binary | + | * Setting dilation to smaller than half of moon_distance generates mask where the voxels with 1.0 values are smaller than the hard-edged molecular-mass binary |
* edge_sigma | * edge_sigma | ||
* In principle, smaller edge_sigma is better. | * In principle, smaller edge_sigma is better. | ||
* However, edge_sigma must be at least larger than 1[pixel]. | * However, edge_sigma must be at least larger than 1[pixel]. | ||
* If not, the density distribution of moon eliminator 3D mask won't be smooth (spiky) because of quantization or digitization. | * If not, the density distribution of moon eliminator 3D mask won't be smooth (spiky) because of quantization or digitization. | ||
- | * In addition, moon-eliminated reference 3D volume will have a strange dent near zero. | + | * In addition, moon-eliminated reference 3D map will have a strange dent near zero. |
- | + | ||
- | Tips about balancing settings of gm_dilation, | + | |
- | * gm_dilation | + | |
- | * Setting dilation to half of gm_edge_width generates mask where the voxels with 1.0 values are same as the hard-edged molecular-mass binary volume (default behaviour). | + | |
- | * Setting dilation to smaller than half of gm_edge_width generates mask where the voxels with 1.0 values are smaller than the hard-edged molecular-mass binary volume. | + | |
- | * gm_edge_width | + | |
- | * A wider gm_edge_width is better. If it is too narrow, soft-edge will have the stair-like gray level change because of quantization or digitization. | + | |
- | * However, if it is too wide, the soft-edge might touch the box boundary and create strange low density shape there. | + | |
- | * gm_edge_sigma | + | |
- | * In principle, smaller gm_edge_sigma is better. | + | |
- | * However, gm_edge_sigma must be at least larger than 1[pixel]. | + | |
- | * If not, the density distribution of moon eliminator 3D mask won't be smooth (spiky) because of quantization or digitization. | + | |
- | * In addition, moon-eliminated reference 3D volume | + | |
\\ | \\ | ||
Line 147: | Line 132: | ||
\\ | \\ | ||
==== Files ==== | ==== Files ==== | ||
- | sparx/bin/sxpipe.py | + | sparx/bin/sp_pipe.py |
\\ | \\ | ||
==== See also ==== | ==== See also ==== | ||
- | [[pipeline: | + | [[pipeline: |
\\ | \\ |