I had to downgrade pandas 2.2.0 to 2.1.4

It is difficult to answer properly since you do not show us how you try to do it. From your error message I can see that you try to convert a numpy array containing objects to a torch tensor. This does not work, you will need a numeric data type:

import torch
import numpy as np

# Your test array without 'dtype=object'
a = np.array([
    np.array([0.5, 1.0, 2.0], dtype=np.float16),
    np.array([4.0, 6.0, 8.0], dtype=np.float16),
])

b = torch.from_numpy(a)

print(a.dtype) # This should not be 'object'
print(b)

Output

float16
tensor([[0.5000, 1.0000, 2.0000],
        [4.0000, 6.0000, 8.0000]], dtype=torch.float16)

Looking at your error there might be some column in which already some numpy arrays are present.

Use this code, it will load without crashing you can debug further:

df = pd.read_csv("xxxxxx.csv", dtype=object)

Check your csv first and verify below link, lt is not a numpy error it is some issue with csv loading

https://pandas.pydata.org/docs/reference/api/pandas.read_csv.html