问题描述
训练rotateE模型,使用embedding异构会报RuntimeError。
RuntimeError: For operation 'add_backward', current input arguments types are <RowTensor, RowTensor>. The 2-th argument type 'RowTensor’ is not supported now. When first argument is "RowTensor', the support arguments types of 'add_backward’operation as follows:<RowTensor, Tensor>
代码仓:https://gitee.com/mindspore/models/tree/master/research/nlp/rotate
Embedding异构:https://www.mindspore.cn/docs/zh-CN/r2.1/design/distributed_training_design.html
问题解答
add_backward应该不接受两个RowTensor,这种调用方式不支持