Hugging Face Datasets uses Apache arrow for manipulating the data and to add a column hugging face has provided an extension to do so.
This got released in the latest version of the library as of the blog publishing date.
Add New Column
Code is straightforward for doing the same but with few minor observations.
When you load the datasets you get a DataSetDict which provides a dictionary of datasets and you have to choose the key. for eg in the above code, you can find it as a train
Happy coding !!!
