Something went wrong on our end
Select Git revision
-
Gregor Kobsik authored
Checks each input if it exceeds 'num_positions' Reevaluates each input multiple times with the given data transformations, otherwise selects another random sample. Thus, no handling of exceesive long inputs needs to be done in Transformer anymore.
Gregor Kobsik authoredChecks each input if it exceeds 'num_positions' Reevaluates each input multiple times with the given data transformations, otherwise selects another random sample. Thus, no handling of exceesive long inputs needs to be done in Transformer anymore.
data.py 4.08 KiB