Afaik, both have the same functionality. A bit difference is the idea behind. OrdinalEncoder is for converting features, while LabelEncoder is for converting target variable.

That's why OrdinalEncoder can fit data that has the shape of (n_samples, n_features) while LabelEncoder can only fit data that has the shape of (n_samples,) (though in the past one used LabelEncoder within the loop to handle what has been becoming the job of OrdinalEncoder now)

Answer from ipramusinto on Stack Exchange
Top answer
1 of 4
51

Afaik, both have the same functionality. A bit difference is the idea behind. OrdinalEncoder is for converting features, while LabelEncoder is for converting target variable.

That's why OrdinalEncoder can fit data that has the shape of (n_samples, n_features) while LabelEncoder can only fit data that has the shape of (n_samples,) (though in the past one used LabelEncoder within the loop to handle what has been becoming the job of OrdinalEncoder now)

2 of 4
30

As for differences in OrdinalEncoder and LabelEncoder implementation, the accepted answer mentions the shape of the data:

  • OrdinalEncoder is for 2D data with the shape (n_samples, n_features)
  • LabelEncoder is for 1D data with the shape (n_samples,)

Maybe that's why the top-voted answer suggests OrdinalEncoder is for the "features" (often a 2D array), whereas LabelEncoder is for the "target variable" (often a 1D array).

That's also why a OrdinalEncoder would get an error if trying to fit on 1D data: OrdinalEncoder().fit(['a','b'])

ValueError: Expected 2D array, got 1D array instead:

Another difference between the encoders is the name of their learned parameter;

  • LabelEncoder learns classes_
  • OrdinalEncoder learns categories_

Notice the differences when fitting LabelEncoder vs OrdinalEncoder, and the differences in the values of the learned parameters.

  • LabelEncoder.fit(...) accepts a 1D array; LabelEncoder.classes_ is 1D
  • OrdinalEncoder.fit(...) accepts a 2D array; OrdinalEncoder.categories_ is 2D.
    LabelEncoder().fit(['a','b']).classes_
    # >>> array(['a', 'b'], dtype='<U1')
    
    OrdinalEncoder().fit([['a'], ['b']]).categories_
    # >>> [array(['a', 'b'], dtype=object)]

This is consistent with the idea that

  • OrdinalEncoder is for your X aka your input features (2D)
  • LabelEncoder is for your y aka your target variables (1D) (also mentioned here):

LabelEncoder should be used to encode target values, i.e. y, and not the input X.

Other encoders that work in 2D, including OneHotEncoder, also use the property categories_

More info here about the dtype <U1 (little-endian , Unicode, 1 byte; i.e. a string with length 1)

EDIT

In the comments to my answer, Piotr disagrees with my answer; but Piotr points out the difference between ordinal encoding and label encoding more generally (vs differences in their implementation). Piotr's right about the general definitions/usages:

  • Ordinal encoding should be used for ordinal variables (where order matters, like cold, warm, hot);
  • vs Label encoding should be used for non-ordinal (aka nominal) variables (where order doesn't matter, like blonde, brunette)

This is a good point, but this question asks about the sklearn classes/implementation. If you want ordinal encoding like Piotr describes (i.e. where order is preserved); you must do the ordinal encoding yourself (neither OrdinalEncoder nor LabelEncoder can infer the order! See the OrdinalEncoder constructor parameter called categories).

As for implementation it seems like LabelEncoder and OrdinalEncoder have consistent behavior as far as the chosen integers. They both assign integers based on alphabetical order. For example:

OrdinalEncoder().fit_transform([['cold'],['warm'],['hot']]).reshape((1,3))
# >>> array([[0., 2., 1.]])

LabelEncoder().fit_transform(['cold','warm','hot'])
# >>> array([0, 2, 1], dtype=int64)

Notice how both encoders assigned integers in alphabetical order 'c'<'h'<'w'.

But this part is important: Notice how neither encoder got the "real" order correct (i.e. the real order should reflect the temperature, where order is 'cold'<'warm'<'hot'; 0<1<2). If the encoders used the "real" order, the value 'warm' would have been assigned the integer 1 (instead of the integer 2)

In the blog post referenced by Piotr, the author does not even use OrdinalEncoder(). To achieve ordinal encoding the author does it manually: maps each temperature to a "real" order integer, using a dictionary like {'cold':0, 'warm':1, 'hot':2}:

Refer to this code using Pandas, where first we need to assign the real order of the variable through a dictionary... Though its very straight forward but it requires coding to tell ordinal values and what is the actual mapping from text to integer as per the order.

In other words, if you're wondering whether to use OrdinalEncoder, please note OrdinalEncoder may not actually provide "ordinal encoding" the way you expect!

EDIT @Magnus Persson pointed out that the OrdinalEncoder class accepts an argument called categories, which you can use to determine/assign the resulting order.

OrdinalEncoder(categories=[['cold','warm','hot']])
    .fit_transform([['hot'],['warm'],['warm'],['cold']])
    .reshape((1,-1))[0]

# Output is:
# >>> array([[2., 1., 1., 0.]])    

EDIT @lbcommer pointed out that there is a Python library category_encoders, which has an OrdinalEncoder class. Note how even that class constructor has a mapping argument so you can choose the resulting order:

the value of ‘mapping’ should be a dictionary of ‘original_label’ to ‘encoded_label’.... example mapping: {‘col’: ‘col1’, ‘mapping’: {None: 0, ‘a’: 1, ‘b’: 2}}, {‘col’: ‘col2’, ‘mapping’: {None: 0, ‘x’: 1, ‘y’: 2}}

🌐
Kaggle
kaggle.com › questions-and-answers › 170936
OrdinalEncoder vs LabelEncoder | Kaggle
Hi everyone, Recently, when I was reading an ML book, I came across sklearn's OrdinalEncoder. I tried it out, and it seems very similar to sklearn's LabelEn...
🌐
Medium
medium.com › @firatozc555 › ordinal-encoding-vs-labelencoding-vs-onehotencoding-6422223a7038
Ordinal Encoding vs LabelEncoding vs OneHotEncoding | by Fırat/Mustafa Özcan | Medium
September 19, 2024 - In machine learning, encoding categorical variables is a crucial preprocessing step. It transforms categorical data into a numerical format that can be understood by machine learning algorithms. There are several encoding techniques available, including OrdinalEncoder, LabelEncoder, and ...
🌐
Kaggle
kaggle.com › questions-and-answers › 312940
Ordinal Encoder vs Label encoder | Kaggle
I dont understand the difference ebetween this two (OrdinalEncoder vs Label encoder) can someone explain it ot me ? There both from sklearn.preprocessing
🌐
Kaggle
kaggle.com › questions-and-answers › 239564
OneHotEncoder VS OrdinalEncoder VS LabelEncoder in scikit-learn | Kaggle
LabelEncoding and OrdinalEncoding are similar in their functionality, and the only difference is their purpose (therefore you can sometimes see the Python code where LabelEncoder is applied for the feature variables - which is exactly the ...
🌐
Trainindata
feature-engine.trainindata.com › en › 1.8.x › user_guide › encoding › OrdinalEncoder.html
Ordinal Encoding — 1.8.3
Scikit-learn provides 2 different ... is, categories, with ordinal data. The OrdinalEncoder is designed to transform the predictor variables (those in the training set), while the LabelEncoder is designed to transform the target variable....
Top answer
1 of 5
48

You were almost there !

Basically the fit method, prepare the encoder (fit on your data i.e. prepare the mapping) but don't transform the data.

You have to call transform to transform the data , or use fit_transform which fit and transform the same data.

enc = OrdinalEncoder()
enc.fit(df[["Sex","Blood", "Study"]])
df[["Sex","Blood", "Study"]] = enc.transform(df[["Sex","Blood", "Study"]])

or directly

enc = OrdinalEncoder()
df[["Sex","Blood", "Study"]] = enc.fit_transform(df[["Sex","Blood", "Study"]])

Note: The values won't be the one that you provided, since internally the fit method use numpy.unique which gives result sorted in alphabetic order and not by order of appearance.

As you can see from enc.categories_

[array(['F', 'M'], dtype=object),
 array(['A', 'AB', 'B', 'O'], dtype=object),
 array(['Biology', 'English', 'Math', 'Science'], dtype=object)]```

Each value in the array is encoded by it's position. (F will be encoded as 0 , M as 1)

2 of 5
34

I think it is important to point out that this is not an example for an ordinal encoding of variables. Sex, Blood and Study should all not have an ordinal scale (and was also not suggested by the person, who asked the question). Ordinal data has a ranking (see e.g. https://en.wikipedia.org/wiki/Ordinal_data) Those examples here do not have a ranking.

In the case that your variable is a target variable you can use the LabelEncoder.(https://scikit-learn.org/stable/modules/generated/sklearn.preprocessing.LabelEncoder.html)

Then you can do something like:

from sklearn.preprocessing import LabelEncoder

for col in ["Sex","Blood", "Study"]:
    df[col] = LabelEncoder().fit_transform(df[col])

If your variables are features you should use the Ordinalencoder for accomplishing this. (See comments to my answer).

The naming for the Ordinalencoder is quite unfortunate as "ordinal" is seen from a mathematical and not a statistical naming perspective.

More on the difference between ordinal- and labelencoder in sklearn: https://datascience.stackexchange.com/questions/39317/difference-between-ordinalencoder-and-labelencoder

🌐
Towards Data Science
towardsdatascience.com › home › artificial intelligence › machine learning › 3 key encoding techniques for machine learning: a beginner-friendly guide
3 Key Encoding Techniques for Machine Learning: A Beginner-Friendly Guide | Towards Data Science
February 7, 2024 - The **OrdinalEncoder** from scikit-learn's preprocessing toolkit is a real gem for handling ordinal variables. It's intuitive, automatically determining the ordinal structure and encoding it accordingly.
Find elsewhere
🌐
MachineLearningMastery
machinelearningmastery.com › home › blog › ordinal and one-hot encodings for categorical data
Ordinal and One-Hot Encodings for Categorical Data - MachineLearningMastery.com
August 17, 2020 - This OrdinalEncoder class is intended ... e.g. a matrix. If a categorical target variable needs to be encoded for a classification predictive modeling problem, then the LabelEncoder class can be used....
🌐
scikit-learn
scikit-learn.org › stable › modules › generated › sklearn.preprocessing.OrdinalEncoder.html
OrdinalEncoder — scikit-learn 1.9.1 documentation
LabelEncoder · Encodes target labels with values between 0 and n_classes-1. Examples · Given a dataset with two features, we let the encoder find the unique values per feature and transform the data to an ordinal encoding. >>> from sklearn.preprocessing import OrdinalEncoder >>> enc = OrdinalEncoder() >>> X = [['Male', 1], ['Female', 3], ['Female', 2]] >>> enc.fit(X) OrdinalEncoder() >>> enc.categories_ [array(['Female', 'Male'], dtype=object), array([1, 2, 3], dtype=object)] >>> enc.transform([['Female', 3], ['Male', 1]]) array([[0., 2.], [1., 0.]]) >>> enc.inverse_transform([[1, 0], [0, 1]]) array([['Male', 1], ['Female', 2]], dtype=object) By default, OrdinalEncoder is lenient towards missing values by propagating them.
🌐
Medium
medium.com › @vipinnation › unraveling-categorical-variables-understanding-label-ordinal-and-one-hot-encoding-techniques-8f5375151fed
Unraveling Categorical Variables: Understanding Label, Ordinal, and One-Hot Encoding Techniques | by Vipin Singh Inkiya | Medium
April 20, 2024 - from sklearn.preprocessing import OrdinalEncoder # Sample data education_levels = [['High School'], ['Bachelor\'s Degree'], ['Master\'s Degree'], ['Ph.D.']] # Create an Ordinal Encoder instance ordinal_encoder = OrdinalEncoder() # Fit and transform the data encoded_education_levels = ordinal_encoder.fit_transform(education_levels) print("Encoded Education Levels:", encoded_education_levels)
🌐
Kaggle
kaggle.com › questions-and-answers › 357800
Label Encoding and Ordinal Encoding
Checking your browser before accessing www.kaggle.com · Click here if you are not automatically redirected after 5 seconds
🌐
C# Corner
c-sharpcorner.com › article › ordinal-label-encoding-in-machine-learning
Ordinal & Label Encoding in Machine Learning
May 10, 2024 - Categorical variables in machine learning require numerical conversion. Ordinal Encoding orders data, while Label Encoding assigns unique values. Python code demonstrates encoding techniques for effective model training.
🌐
Medium
tahera-firdose.medium.com › understanding-categorical-encoding-techniques-ordinal-one-hot-and-label-encoding-4ad209c13e06
Understanding Categorical Encoding Techniques: Ordinal, One-Hot, and Label Encoding | by Tahera Firdose | Medium
December 8, 2023 - Understanding Categorical Encoding Techniques: Ordinal, One-Hot, and Label Encoding Introduction: Categorical variables are an essential part of data analysis, but they cannot be directly processed …
🌐
Indian AI Production
indianaiproduction.com › home › blog › label encoding vs ordinal encoding | categorical variable encoding
Label Encoding vs Ordinal Encoding | Categorical Variable Encoding
July 10, 2020 - Machine Learning algorithm cant work on categorical data so we have to encode categorical variables in Label & Ordinal encoding.
🌐
Com
qastack.com.de › datascience › 39317 › difference-between-ordinalencoder-and-labelencoder
Unterschied zwischen OrdinalEncoder und LabelEncoder
Aus diesem Grund OrdinalEncoderkönnen Daten, die die Form von (n_samples, n_features)while haben, LabelEncodernur Daten angepasst werden, die die Form von haben (n_samples,)(obwohl sie in der Vergangenheit LabelEncoderinnerhalb der Schleife verwendet wurden, um das zu handhaben, was OrdinalEncoderjetzt zur Aufgabe geworden ist ).
🌐
Qastack
qastack.fr › datascience › 39317 › difference-between-ordinalencoder-and-labelencoder
Différence entre OrdinalEncoder et LabelEncoder
C'est pourquoi OrdinalEncoderpeut ajuster des données qui ont la forme de (n_samples, n_features)tandis que LabelEncoderne peut s'adapter que des données qui ont la forme de (n_samples,)(bien que dans le passé utilisé LabelEncoderdans la boucle pour gérer ce qui est devenu le travail de OrdinalEncodermaintenant)