Embedding Variable

Embedding Variable使用key,value键值对形式存储稀疏数据，它具有以下特点：

1. EV, like Variable, is stateful operation. It stores sparse parameters. It only used in Embedding Layer.
2. EV can connect necessary Operations to build a whole graph, such as: Gather, SparseApply, Save, Send Op.
3. EV’s first dimension is dynamic. EV can enlarge or shrink in reasonable range according to user‘s configuration.
4. EV send/receive via rendezvous without extra memory copy.
5. EV supports incremental checkpoint to speed up model save/restore and save disk space.

References:

[1]: 社区分享 | TensorFlow Recommenders-Addons 现已开源，让推荐系统效果更好！

https://mp.weixin.qq.com/s/84VSdaBBhFn9GXQ9x0WXww

[3]: RFC: Embedding Variable

• RFC: Embedding Variable

• RFC: Dynamic Embedding

• dynamic_embedding_tutorial.ipynb

https://github.com/tengkz/tensorflow_notes