How to feed data to a transformer – ABN Techweek

If you think about Transformers, chances are you are thinking about NLP applications but how can we use Transformers for data types other than text? Actually, you can use Transformers on any data that you are able to express as a sequence of vectors, which is what Transformers feed on! Typically any sequence or time series of data points should be able to fit the bill.