Protocol Documentation

The number of heads Default: 1

The dimension of heads 

The number of interacting layers Default: 1

 Default: 0.0001

 Default: 0.0001

 Default: true

mini batch size to use for training and evaluation. Default: 32

set auto_expand_input_fields to true to
auto_expand field[1-21] to field1, field2, ..., field21 Default: false

label fields, normally only one field is used.
For multiple target models such as MMOE
multiple label_fields will be set. 

label separator 

label dimensions which need to be set when there
are labels have dimension > 1 

whether to shuffle data Default: true

shufffle buffer for better performance, even shuffle buffer is set,
it is suggested to do full data shuffle before training
especially when the performance of models is not good. Default: 32

The number of times a data source is read. If set to zero, the data source
will be reused indefinitely. Default: 0

Number of decoded batches to prefetch. Default: 32

shard dataset to 1/num_workers in distribute mode Default: false

separator of column features, only used for CSVInput*
not used in OdpsInput*
binary separators are supported:
  CTRL+A could be set as '\001'
  CTRL+B could be set as '\002'
  CTRL+C could be set as '\003'
for RTPInput and OdpsRTPInput it is usually set
to '\002' Default: ,

parallel preproces of raw data, avoid using too small
or too large numbers(suggested be to small than
number of the cores) Default: 8

only used for OdpsInput/OdpsInputV2/OdpsRTPInput, comma separated
for RTPInput, selected_cols use indices as column names
 such as '1,2,4', where 1,2 are label columns, and
 4 is the feature column, column 0,3 are not used, 

selected col types, only used for OdpsInput/OdpsInputV2
to avoid error setting of data types 

the input fields must be the same number and in the
same order as data in csv files or odps tables 

for RTPInput only Default: ;

ignore some data errors
it is not suggested to set this parameter Default: false

whether to use pai global shuffle queue, only for OdpsInput,
OdpsInputV2, OdpsRTPInputV2 Default: false

 Default: 100

if true, one worker will duplicate the data of the chief node
and undertake the gradient computation of the chief node Default: false

input field for sample weight 

the compression type of tfrecord 

n data for one feature in tfrecord 

for csv files, may optionally with an header
in that case, input_name must match header name,
and the number and the order of input_fields
may not be the same as that in csv files. Default: false

 Default: 4096

 Default: STRING

 Default: 1

 Default: 1

user data path
userid weight 

item data path
itemid weight attrs 

hard negative edge path
userid itemid weight 

number of negative sample 

max number of hard negative sample 

field names of attrs in train data or eval data 

field name of item_id in train data or eval data 

field name of user_id in train data or eval data 

 Default: :

 Default: 0

user data path
userid weight 

item data path
itemid weight attrs 

positive edge path
userid itemid weight 

hard negative edge path
userid itemid weight 

number of negative sample 

max number of hard negative sample 

field names of attrs in train data or eval data 

field name of item_id in train data or eval data 

field name of user_id in train data or eval data 

 Default: :

 Default: 0

sample data path
itemid weight attrs 

number of negative sample 

field names of attrs in train data or eval data 

field name of item_id in train data or eval data 

 Default: :

 Default: 0

user data path
userid weight 

item data path
itemid weight attrs 

positive edge path
userid itemid weight 

number of negative sample 

field names of attrs in train data or eval data 

field name of item_id in train data or eval data 

field name of user_id in train data or eval data 

 Default: :

 Default: 0

shared bottom dnn layer 

mmoe expert dnn layer definition 

number of mmoe experts Default: 0

bayes task tower 

l2 regularization Default: 0.0001

The number of cross layers Default: 3

 Default: 0.0001

 Default: 1

deprecated Default: 0.0001

deprecated Default: 0.0001

 Default: 0.0001

options are: dot and cat Default: dot

whether a feature will interact with itself Default: false

whether to include dense features after interaction Default: false

 Default: 1e-05

hidden units for each layer 

ratio of dropout 

activation function Default: tf.nn.relu

use batch normalization Default: true

 Default: 0

 Default: 0

 Default: 0.5

 Default: 0.0001

 Default: COSINE

add a layer for scaling the similarity Default: true

例如输入特征为"1005,109;0;93eaba74",此时分号分割的为column，
逗号分割的为每个column的多个feature, 下划线分割为feature名字和对应的value。 

指定字符串hash分桶的算法，支持HarmHash（对应于tf.strings.to_hash_bucket_fast()）
和SipHash(对应于tf.strings.to_hash_bucket_strong())两种字符串hash分桶算法 

embedding_name to embedding 

指定embedding lookup的结果的最大L2-norm 

指定embedding的combiner策略，支持sum, mean和sqrtn 

指定该embedding切分的总数 

指定EmbeddingPartData(*.pb)所在的路径 

指定该embedding part所属第几个part 

指定该embedding part的shape(可以从EmbeddingPartData中读取) 

embedding part的部署策略, 支持本地部署（local）和远程部署(remote) 

Shape of the embedding 

Data 

指定模型所在路径，便于加载模型 

指定模型的sinature的名字 

model input description 

actually input layers, each layer produce a group of feature 

implemented in easy_rec/python/model/easy_rec_estimator
add regularization to all variables with "embedding_weights:"
in name Default: 0

 Default: CLASSIFICATION

 Default: 1

 Default: false

filter variables matching any pattern in restore_filters
common filters are Adam, Momentum, etc. 

default to be logits Default: true

for CROSS_ENTROPY_LOSS, soft_label must be logits instead of probs 

default to be logits Default: true

currently only support CROSS_ENTROPY_LOSS and L2_LOSS 

 Default: 1

only for loss_type == CROSS_ENTROPY_LOSS Default: 1

 Default: 0.0001

 Default: 200

 Default: 5

Number of examples to process of evaluation. Default: 0

How often to run evaluation. Default: 300

Maximum number of times to run evaluation. If set to 0, will run forever. Default: 0

Whether the TensorFlow graph used for evaluation should be saved to disk. Default: false

Type of metrics to use for evaluation.
possible values: 

Evaluation online with batch forward data of training Default: false

uid field name 

reduction method for auc of different users
* "mean": simple mean of different users
* "mean_by_sample_num": weighted mean with sample num of different users
* "mean_by_positive_num": weighted mean with positive sample num of different users Default: mean

 Default: 5

session id field name 

reduction: reduction method for auc of different sessions
* "mean": simple mean of different sessions
* "mean_by_sample_num": weighted mean with sample num of different sessions
* "mean_by_positive_num": weighted mean with positive sample num of different sessions Default: mean

batch size used for exported model, -1 indicates batch_size is None
which is only supported by classification model right now, while
other models support static batch_size Default: -1

type of exporter [final | latest | best | none] when train_and_evaluation
final: performs a single export in the end of training
latest: regularly exports the serving graph and checkpoints
latest: export the best model according to best_exporter_metric
none: do not perform export Default: final

the metric used to determine the best checkpoint Default: auc

metric value the bigger the best Default: true

enable early stop Default: false

custom early stop function, format:
   early_stop_func(eval_results, early_stop_params)
return True if should stop 

custom early stop parameters 

early stop max check steps Default: 10000

each feature has a placeholder Default: true

export to keep, only for exporter_type in [best, latest] Default: 1

multi value field list 

is placeholder named by input Default: false

filter out inputs, only keep effective ones Default: true

export the original feature values as string Default: false

export the outputs required by RTP Default: false

input field names: must be included in DatasetConfig.input_fields 

 Default: IdFeature

 Default: 0

 Default: 0

for categorical_column_with_identity Default: 0

only for raw features 

separator with in features Default: |

delimeter to separator key from value 

delimeter to separate sequence multi-values 

many other field share this config 

lookup max select element number, default 10 Default: 10

max_partitions Default: 1

combiner Default: mean

embedding initializer 

number of digits kept after dot in format float/double to string
scientific format is not used.
in default it is not allowed to convert float/double to string Default: -1

normalize raw feature to [0-1] Default: 0

 Default: 0

raw feature of multiple dimensions Default: 1

sequence feature combiner 

sub feature type for sequence feature Default: IdFeature

sequence length Default: 1

for expr feature 

 Default: DEEP

 Default: false

 Default: false

 Default: 0.0001

hive master's ip 

hive port Default: 10000

hive username 

hive database Default: default

 Default: 0

 Default: 512

 Default: 1

 Default: 1

 Default: 1

 Default: 1

 Default: 0

 Default: 1

 Default: 0

 Default: 1

 Default: 0.25

 Default: 32

 Default: 1

 Default: 2

 Default: 50

 Default: 1

 Default: 0.1

 Default: 0

 Default: 1

 Default: 1

max number of high capsules Default: 5

max behaviour sequence length 

high capsule embedding vector dimension 

number EM iterations Default: 3

routing logits scale Default: 20

routing logits initial stddev Default: 1

preprocessing dnn before entering capsule layer 

dnn layers applied on concated results of
capsule output and user_context(none sequence features) 

method to combine several user sequences
such as item_ids, category_ids Default: SUM

dnn layers applied on item features 

similarity power, the paper says that the big
the better Default: 10

 Default: COSINE

 Default: 0.0001

deprecated: original mmoe experts config 

mmoe expert dnn layer definition 

number of mmoe experts Default: 0

task tower 

l2 regularization Default: 0.0001

 Default: 5

 Default: 4

 Default: 0.0001

 Default: 0.9

 Default: 0.999

 Default: 1e-06

 Default: 0.9

 Default: 0.999

 Default: 0.9

 Default: 0.999

 Default: 1e-06

 Default: 0.9

 Default: 0.999

 Default: 0.002

 Default: 0.002

 Default: 4000000

 Default: 0.0002

 Default: 10000

 Default: 0

 Default: 0.002

 Default: 4000000

 Default: 0.95

 Default: true

 Default: 0

 Default: 0

 Default: 0

optional float learning_rate = 1 [default=1e-4]; 

 Default: -0.5

 Default: 0.1

 Default: 0

 Default: 0

 Default: 0

 Default: 0.002

Whether to linearly interpolate learning rates for steps in
[0, schedule[0].step]. Default: false

 Default: 0.002

 Default: 0.9

 Default: 1e-06

 Default: 0.9

 Default: false

 Default: 0.9999

 Default: 0

 Default: 0.9

 Default: 0.9

 Default: 1

 Default: 1

train config, including optimizer, weight decay, num_steps and so on 

for compatibility 

recommendation model config 

number of experts per task 

number of experts for share
For the last extraction_network, no need to configure this 

dnn network of experts per task 

dnn network of experts for share
For the last extraction_network, no need to configure this 

extraction network 

task tower 

l2 regularization Default: 0.0001

 Default: 0.0001

 Default: false

COSINE = 0; EUCLID = 1; Default: COSINE

 Default: 0.0001

task name for the task tower 

label for the task, default is label_fields by order 

metrics for the task 

loss for the task Default: CLASSIFICATION

num_class for multi-class classification loss Default: 1

task specific dnn 

related tower names 

relation dnn 

training loss weights Default: 1

label name for indcating the sample space for the task tower 

the loss weight for sample in the task space Default: 1

the loss weight for sample out the task space

level for prediction
required uint32 prediction_level = 13;
prediction weights
optional float prediction_weight = 14 [default = 1.0]; Default: 1

task name for the task tower 

label for the task, default is label_fields by order 

metrics for the task 

loss for the task Default: CLASSIFICATION

num_class for multi-class classification loss Default: 1

task specific dnn 

training loss weights Default: 1

label name for indcating the sample space for the task tower 

the loss weight for sample in the task space Default: 1

the loss weight for sample out the task space Default: 1

optimizer options 

If greater than 0, clips gradients by this value. Default: 0

Number of steps to train the models: if 0, will train the model
indefinitely. Default: 0

Checkpoint to restore variables from. 

Whether to synchronize replicas during training.
In case so, build a SyncReplicateOptimizer Default: true

only take effect on pai-tf when sync_replicas is set,
options are:
    raw, hash, multi_map, list, parallel
in general, multi_map runs faster than other options. Default: multi_map

Number of training steps between replica startup.
This flag must be set to 0 if sync_replicas is set to true. Default: 15

Step interval for saving checkpoint Default: 1000

Seconds interval for saving checkpoint 

Max checkpoints to keep Default: 10

Save summaries every this many steps. Default: 1000

The frequency global step/sec and the loss will be logged during training. Default: 10

profiling or not Default: false

if variable shape is incompatible, clip or pad variables in checkpoint Default: false

DistributionStrategy, available values are 'mirrored' and 'collective' and 'ess'
- mirrored: MirroredStrategy, single machine and multiple devices;
- collective: CollectiveAllReduceStrategy, multiple machines and multiple devices. Default: NoStrategy

Number of gpus per machine Default: 1

summary model variables or not Default: false

distribute training protocol [grpc++ | star_server]
grpc++: https://help.aliyun.com/document_detail/173157.html?spm=5176.10695662.1996646101.searchclickresult.3ebf450evuaPT3
star_server: https://help.aliyun.com/document_detail/173154.html?spm=a2c4g.11186623.6.627.39ad7e3342KOX4 

inter_op_parallelism_threads Default: 0

intra_op_parallelism_threads Default: 0

tensor fusion on PAI-TF Default: false

write graph into graph.pbtxt and summary or not Default: true

match variable patterns to freeze 

regularization coefficient lambda Default: 0.01

variational_dropout dimension Default: false

 Default: 1

if set, the output of dnn and wide part are concatenated and
passed to the final_dnn; otherwise, they are summarized 

 Default: 0.0001