I run python train.py, and get the mentioned error in title, and the full log is as below.
What could be the reason?
cat transrac_training_repcounta_250623220056.log
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/torch/utils/cpp_extension.py:3: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
import imp
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/matplotlib/init.py:169: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
if LooseVersion(module.version) < minver:
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/setuptools/_distutils/version.py:351: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
other = LooseVersion(other)
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/matplotlib/init.py:169: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
if LooseVersion(module.version) < minver:
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/setuptools/_distutils/version.py:351: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
other = LooseVersion(other)
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/matplotlib/init.py:169: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
if LooseVersion(module.version) < minver:
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/setuptools/_distutils/version.py:351: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
other = LooseVersion(other)
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/matplotlib/init.py:169: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
if LooseVersion(module.version) < minver:
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/setuptools/_distutils/version.py:351: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
other = LooseVersion(other)
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/matplotlib/init.py:169: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
if LooseVersion(module.version) < minver:
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/setuptools/_distutils/version.py:351: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
other = LooseVersion(other)
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/pandas/compat/numpy/init.py:10: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
_nlv = LooseVersion(_np_version)
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/pandas/compat/numpy/init.py:11: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
np_version_under1p17 = _nlv < LooseVersion("1.17")
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/pandas/compat/numpy/init.py:12: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
np_version_under1p18 = _nlv < LooseVersion("1.18")
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/pandas/compat/numpy/init.py:13: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
_np_version_under1p19 = _nlv < LooseVersion("1.19")
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/pandas/compat/numpy/init.py:14: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
_np_version_under1p20 = _nlv < LooseVersion("1.20")
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/setuptools/_distutils/version.py:351: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
other = LooseVersion(other)
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/pandas/compat/numpy/function.py:120: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
if LooseVersion(version) >= LooseVersion("1.17.0"):
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/pandas/compat/numpy/function.py:120: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
if LooseVersion(version) >= LooseVersion("1.17.0"):
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/seaborn/rcmod.py:82: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
if LooseVersion(mpl.version) >= "3.0":
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/setuptools/_distutils/version.py:351: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
other = LooseVersion(other)
apex is not installed
load checkpoint from local path: ./pretrained/swin_tiny_patch244_window877_kinetics400_1k.pth
--------- backbone loaded ------------
0%| | 0/200 [00:00<?, ?it/s] /home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/torch/cuda/nccl.py:48: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3, and in 3.10 it will stop working
if not isinstance(inputs, collections.Container) or isinstance(inputs, torch.Tensor):
100%|██████████| 190/190 [06:40<00:00, 2.11s/it, Epoch=0, loss_train=0.108, Train MAE=0.357, Train OBO =0]
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/numpy/core/fromnumeric.py:3440: RuntimeWarning: Mean of empty slice.
return _methods._mean(a, axis=axis, dtype=dtype,
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/numpy/core/_methods.py:189: RuntimeWarning: invalid value encountered in double_scalars
ret = ret.dtype.type(ret / rcount)
100%|██████████| 190/190 [06:33<00:00, 2.07s/it, Epoch=1, loss_train=0.0448, Train MAE=1.84, Train OBO =0]
100%|██████████| 190/190 [06:37<00:00, 2.09s/it, Epoch=2, loss_train=0.0264, Train MAE=3.8, Train OBO =0]]
100%|██████████| 190/190 [06:39<00:00, 2.10s/it, Epoch=3, loss_train=0.0248, Train MAE=0.0875, Train OBO =0.5]]
100%|██████████| 190/190 [06:45<00:00, 2.13s/it, Epoch=4, loss_train=0.0777, Train MAE=0.333, Train OBO =0].5]5]
20%|██ | 38/190 [01:31<06:06, 2.41s/it, Epoch=5, loss_train=0.0583, Train MAE=0.618, Train OBO =0]] ]
2%|▎ | 5/200 [34:50<22:38:46, 418.09s/it]och=5, loss_train=0.0583, Train MAE=0.618, Train OBO =0]
Traceback (most recent call last):
File "train.py", line 46, in
train_loop(NUM_EPOCHS, my_model, train_dataset, valid_dataset, train=True, valid=True,
File "/home/boil/xgs/cv/TransRAC/training/train_looping.py", line 70, in train_loop
for input, target in pbar:
File "/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/tqdm/std.py", line 1178, in iter
for obj in iterable:
File "/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 435, in next
data = self._next_data()
File "/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1085, in _next_data
return self._process_data(data)
File "/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1111, in _process_data
data.reraise()
File "/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/torch/_utils.py", line 428, in reraise
raise self.exc_type(msg)
RuntimeError: Caught RuntimeError in DataLoader worker process 6.
Original Traceback (most recent call last):
File "/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/torch/utils/data/_utils/worker.py", line 198, in _worker_loop
data = fetcher.fetch(index)
File "/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/torch/utils/data/_utils/fetch.py", line 47, in fetch
return self.collate_fn(data)
File "/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/torch/utils/data/_utils/collate.py", line 83, in default_collate
return [default_collate(samples) for samples in transposed]
File "/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/torch/utils/data/_utils/collate.py", line 83, in
return [default_collate(samples) for samples in transposed]
File "/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/torch/utils/data/_utils/collate.py", line 55, in default_collate
return torch.stack(batch, 0, out=out)
RuntimeError: result type Float can't be cast to the desired output type Long
I only change some basic configs during training environment setup, and the diff results of git repo are as below.
git diff
diff --git a/requirements.txt b/requirements.txt
index 72f073e..affedc9 100644
--- a/requirements.txt
+++ b/requirements.txt
@@ -11,10 +11,8 @@ lmdb==1.3.0
lws==1.2.7
matplotlib==3.3.4
mmcls==0.22.0
-mmcv==1.4.8
-mmcv_full==1.3.16
mmdet==2.23.0
-numpy==1.20.1
+numpy==1.21.0
onnx==1.11.0
onnxruntime==1.11.0
opencv_python==4.5.4.60
@@ -27,6 +25,4 @@ sympy==1.8
tensorboardX==2.5
tensorrt==0.0.1
timm==0.4.12
-torch==1.7.0+cu110
-torchvision==0.8.0
-tqdm==4.59.0
+tqdm==4.65.0
diff --git a/tools/video2npz.py b/tools/video2npz.py
index 13bc31c..26dc173 100644
--- a/tools/video2npz.py
+++ b/tools/video2npz.py
@@ -166,9 +166,9 @@ class MyDataset(Dataset):
if name == 'main':
- data_root = r'/p300/LLSP'
- data_root = r'/home/boil/xgs/cv/RepCount[cvpr2022]/LLSP'
tag = ['train', 'valid', 'test']
- npy_dir = r'/home/boil/xgs/cv/RepCount[cvpr2022]/LLSP/'
for _ in range(3):
mod = tag[_]
label_file = mod + '.csv'
diff --git a/train.py b/train.py
index 82ddde5..454233b 100644
--- a/train.py
+++ b/train.py
@@ -10,20 +10,20 @@ from models.TransRAC import TransferModel
from training.train_looping import train_loop
CUDA environment
-N_GPU = 4
+N_GPU = 2
device_ids = [i for i in range(N_GPU)]
-os.environ["CUDA_VISIBLE_DEVICES"] = "0,1,2,3"
+os.environ["CUDA_VISIBLE_DEVICES"] = "0,1"
# # we pick out the fixed frames from raw video file, and we store them as .npz file
# # we currently support 64 or 128 frames
data root path
-root_path = '/public/home/huhzh/LSP_dataset/LLSP_npz(64)/'
+root_path = '/home/boil/xgs/cv/RepCount[cvpr2022]/LLSP/'
-train_video_dir = 'train'
-train_label_dir = 'train.csv'
-valid_video_dir = 'valid'
-valid_label_dir = 'valid.csv'
+train_video_dir = 'video/train'
+train_label_dir = 'annotation/train.csv'
+valid_video_dir = 'video/valid'
+valid_label_dir = 'annotation/valid.csv'
please make sure the pretrained model path is correct
checkpoint = './pretrained/swin_tiny_patch244_window877_kinetics400_1k.pth'
@@ -41,7 +41,7 @@ valid_dataset = MyData(root_path, valid_video_dir, valid_label_dir, num_frame=NU
my_model = TransferModel(config=config, checkpoint=checkpoint, num_frames=NUM_FRAME, scales=SCALES, OPEN=False)
NUM_EPOCHS = 200
LR = 8e-6
-BATCH_SIZE = 32
+BATCH_SIZE = 4
train_loop(NUM_EPOCHS, my_model, train_dataset, valid_dataset, train=True, valid=True,
batch_size=BATCH_SIZE, lr=LR, saveckpt=True, ckpt_name='ours', log_dir='ours', device_ids=device_ids,
(END)
the conda environment output is as below.
pip list
Package Version Editable project location
addict 2.4.0
aliyun-python-sdk-core 2.16.0
aliyun-python-sdk-kms 2.16.5
anykeystore 0.2
apex 0.9.10.dev0
audioread 3.0.1
av 9.1.0
bypy 1.8.9
certifi 2025.6.15
cffi 1.17.1
charset-normalizer 3.4.2
click 8.1.8
colorama 0.4.6
crcmod 1.7
cryptacular 1.6.2
cryptography 45.0.4
cycler 0.12.1
dataclasses 0.6
decorator 5.2.1
decord 0.6.0
defusedxml 0.7.1
dill 0.4.0
einops 0.3.2
filelock 3.14.0
flatbuffers 25.2.10
future 1.0.0
greenlet 3.1.1
hupper 1.12.1
idna 3.10
imageio 2.9.0
imgaug 0.4.0
importlib_metadata 8.5.0
importlib_resources 6.4.5
jmespath 0.10.0
joblib 1.0.1
kiwisolver 1.4.7
kornia 0.5.11
librosa 0.9.1
llvmlite 0.41.1
lmdb 1.3.0
lws 1.2.7
Markdown 3.7
markdown-it-py 3.0.0
MarkupSafe 2.1.5
matplotlib 3.3.4
mdurl 0.1.2
mmaction2 1.2.0 /home/boil/xgs/cv/mmaction2
mmcls 0.22.0
mmcv 1.4.8
mmcv-full 1.3.17
mmdet 2.23.0
model-index 0.1.11
mpmath 1.3.0
multiprocess 0.70.18
networkx 3.1
numba 0.58.0
numpy 1.21.0
oauthlib 3.3.1
onnx 1.11.0
onnxruntime 1.11.0
opencv-contrib-python 4.5.5.62
opencv-python 4.5.4.60
opendatalab 0.0.10
openmim 0.3.9
openxlab 0.1.2
ordered-set 4.1.0
oss2 2.17.0
packaging 24.2
pandas 1.2.4
PasteDeploy 3.1.0
pbkdf2 1.3
Pillow 9.0.1
pip 25.0.1
plaster 1.1.2
plaster-pastedeploy 1.0.1
platformdirs 4.3.6
pooch 1.8.2
protobuf 3.20.3
pycocotools 2.0.7
pycparser 2.22
pycryptodome 3.23.0
Pygments 2.19.2
pyparsing 3.1.4
pyramid 2.0.2
pyramid-mailer 0.15.1
python-dateutil 2.9.0.post0
python3-openid 3.2.0
pytz 2023.4
PyWavelets 1.4.1
PyYAML 6.0.2
repoze.sendmail 4.4.1
requests 2.28.2
requests-oauthlib 2.0.0
requests-toolbelt 1.0.0
resampy 0.4.3
rich 13.4.2
scikit-image 0.18.1
scikit-learn 1.1.3
scipy 1.6.2
seaborn 0.11.1
setuptools 60.2.0
shapely 2.0.7
six 1.17.0
soundfile 0.13.1
SQLAlchemy 2.0.41
sympy 1.8
tabulate 0.9.0
tensorboardX 2.5
tensorrt 0.0.1
terminaltables 3.1.10
threadpoolctl 3.5.0
tifffile 2023.7.10
timm 0.4.12
tomli 2.2.1
torch 1.7.0+cu110
torchaudio 0.7.0
torchvision 0.8.1+cu110
tqdm 4.65.0
transaction 5.0
translationstring 1.4
typing_extensions 4.12.2
tzdata 2025.2
urllib3 1.26.20
velruse 1.1.1
venusian 3.1.1
WebOb 1.8.9
wheel 0.45.1
WTForms 3.1.2
wtforms-recaptcha 0.3.2
yapf 0.43.0
zipp 3.20.2
zope.deprecation 5.0
zope.interface 7.2
zope.sqlalchemy 3.1
I run python train.py, and get the mentioned error in title, and the full log is as below.
What could be the reason?
cat transrac_training_repcounta_250623220056.log
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/torch/utils/cpp_extension.py:3: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
import imp
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/matplotlib/init.py:169: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
if LooseVersion(module.version) < minver:
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/setuptools/_distutils/version.py:351: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
other = LooseVersion(other)
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/matplotlib/init.py:169: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
if LooseVersion(module.version) < minver:
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/setuptools/_distutils/version.py:351: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
other = LooseVersion(other)
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/matplotlib/init.py:169: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
if LooseVersion(module.version) < minver:
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/setuptools/_distutils/version.py:351: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
other = LooseVersion(other)
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/matplotlib/init.py:169: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
if LooseVersion(module.version) < minver:
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/setuptools/_distutils/version.py:351: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
other = LooseVersion(other)
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/matplotlib/init.py:169: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
if LooseVersion(module.version) < minver:
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/setuptools/_distutils/version.py:351: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
other = LooseVersion(other)
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/pandas/compat/numpy/init.py:10: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
_nlv = LooseVersion(_np_version)
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/pandas/compat/numpy/init.py:11: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
np_version_under1p17 = _nlv < LooseVersion("1.17")
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/pandas/compat/numpy/init.py:12: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
np_version_under1p18 = _nlv < LooseVersion("1.18")
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/pandas/compat/numpy/init.py:13: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
_np_version_under1p19 = _nlv < LooseVersion("1.19")
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/pandas/compat/numpy/init.py:14: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
_np_version_under1p20 = _nlv < LooseVersion("1.20")
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/setuptools/_distutils/version.py:351: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
other = LooseVersion(other)
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/pandas/compat/numpy/function.py:120: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
if LooseVersion(version) >= LooseVersion("1.17.0"):
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/pandas/compat/numpy/function.py:120: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
if LooseVersion(version) >= LooseVersion("1.17.0"):
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/seaborn/rcmod.py:82: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
if LooseVersion(mpl.version) >= "3.0":
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/setuptools/_distutils/version.py:351: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
other = LooseVersion(other)
apex is not installed
load checkpoint from local path: ./pretrained/swin_tiny_patch244_window877_kinetics400_1k.pth
--------- backbone loaded ------------
0%| | 0/200 [00:00<?, ?it/s] /home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/torch/cuda/nccl.py:48: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3, and in 3.10 it will stop working
if not isinstance(inputs, collections.Container) or isinstance(inputs, torch.Tensor):
100%|██████████| 190/190 [06:40<00:00, 2.11s/it, Epoch=0, loss_train=0.108, Train MAE=0.357, Train OBO =0]
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/numpy/core/fromnumeric.py:3440: RuntimeWarning: Mean of empty slice.
return _methods._mean(a, axis=axis, dtype=dtype,
/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/numpy/core/_methods.py:189: RuntimeWarning: invalid value encountered in double_scalars
ret = ret.dtype.type(ret / rcount)
100%|██████████| 190/190 [06:33<00:00, 2.07s/it, Epoch=1, loss_train=0.0448, Train MAE=1.84, Train OBO =0]
100%|██████████| 190/190 [06:37<00:00, 2.09s/it, Epoch=2, loss_train=0.0264, Train MAE=3.8, Train OBO =0]]
100%|██████████| 190/190 [06:39<00:00, 2.10s/it, Epoch=3, loss_train=0.0248, Train MAE=0.0875, Train OBO =0.5]]
100%|██████████| 190/190 [06:45<00:00, 2.13s/it, Epoch=4, loss_train=0.0777, Train MAE=0.333, Train OBO =0].5]5]
20%|██ | 38/190 [01:31<06:06, 2.41s/it, Epoch=5, loss_train=0.0583, Train MAE=0.618, Train OBO =0]] ]
2%|▎ | 5/200 [34:50<22:38:46, 418.09s/it]och=5, loss_train=0.0583, Train MAE=0.618, Train OBO =0]
Traceback (most recent call last):
File "train.py", line 46, in
train_loop(NUM_EPOCHS, my_model, train_dataset, valid_dataset, train=True, valid=True,
File "/home/boil/xgs/cv/TransRAC/training/train_looping.py", line 70, in train_loop
for input, target in pbar:
File "/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/tqdm/std.py", line 1178, in iter
for obj in iterable:
File "/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 435, in next
data = self._next_data()
File "/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1085, in _next_data
return self._process_data(data)
File "/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1111, in _process_data
data.reraise()
File "/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/torch/_utils.py", line 428, in reraise
raise self.exc_type(msg)
RuntimeError: Caught RuntimeError in DataLoader worker process 6.
Original Traceback (most recent call last):
File "/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/torch/utils/data/_utils/worker.py", line 198, in _worker_loop
data = fetcher.fetch(index)
File "/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/torch/utils/data/_utils/fetch.py", line 47, in fetch
return self.collate_fn(data)
File "/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/torch/utils/data/_utils/collate.py", line 83, in default_collate
return [default_collate(samples) for samples in transposed]
File "/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/torch/utils/data/_utils/collate.py", line 83, in
return [default_collate(samples) for samples in transposed]
File "/home/boil/.conda/envs/xgs_transrac_py38/lib/python3.8/site-packages/torch/utils/data/_utils/collate.py", line 55, in default_collate
return torch.stack(batch, 0, out=out)
RuntimeError: result type Float can't be cast to the desired output type Long
I only change some basic configs during training environment setup, and the diff results of git repo are as below.
git diff
diff --git a/requirements.txt b/requirements.txt
index 72f073e..affedc9 100644
--- a/requirements.txt
+++ b/requirements.txt
@@ -11,10 +11,8 @@ lmdb==1.3.0
lws==1.2.7
matplotlib==3.3.4
mmcls==0.22.0
-mmcv==1.4.8
-mmcv_full==1.3.16
mmdet==2.23.0
-numpy==1.20.1
+numpy==1.21.0
onnx==1.11.0
onnxruntime==1.11.0
opencv_python==4.5.4.60
@@ -27,6 +25,4 @@ sympy==1.8
tensorboardX==2.5
tensorrt==0.0.1
timm==0.4.12
-torch==1.7.0+cu110
-torchvision==0.8.0
-tqdm==4.59.0
+tqdm==4.65.0
diff --git a/tools/video2npz.py b/tools/video2npz.py
index 13bc31c..26dc173 100644
--- a/tools/video2npz.py
+++ b/tools/video2npz.py
@@ -166,9 +166,9 @@ class MyDataset(Dataset):
if name == 'main':
tag = ['train', 'valid', 'test']
for _ in range(3):
mod = tag[_]
label_file = mod + '.csv'
diff --git a/train.py b/train.py
index 82ddde5..454233b 100644
--- a/train.py
+++ b/train.py
@@ -10,20 +10,20 @@ from models.TransRAC import TransferModel
from training.train_looping import train_loop
CUDA environment
-N_GPU = 4
+N_GPU = 2
device_ids = [i for i in range(N_GPU)]
-os.environ["CUDA_VISIBLE_DEVICES"] = "0,1,2,3"
+os.environ["CUDA_VISIBLE_DEVICES"] = "0,1"
# # we pick out the fixed frames from raw video file, and we store them as .npz file
# # we currently support 64 or 128 frames
data root path
-root_path = '/public/home/huhzh/LSP_dataset/LLSP_npz(64)/'
+root_path = '/home/boil/xgs/cv/RepCount[cvpr2022]/LLSP/'
-train_video_dir = 'train'
-train_label_dir = 'train.csv'
-valid_video_dir = 'valid'
-valid_label_dir = 'valid.csv'
+train_video_dir = 'video/train'
+train_label_dir = 'annotation/train.csv'
+valid_video_dir = 'video/valid'
+valid_label_dir = 'annotation/valid.csv'
please make sure the pretrained model path is correct
checkpoint = './pretrained/swin_tiny_patch244_window877_kinetics400_1k.pth'
@@ -41,7 +41,7 @@ valid_dataset = MyData(root_path, valid_video_dir, valid_label_dir, num_frame=NU
my_model = TransferModel(config=config, checkpoint=checkpoint, num_frames=NUM_FRAME, scales=SCALES, OPEN=False)
NUM_EPOCHS = 200
LR = 8e-6
-BATCH_SIZE = 32
+BATCH_SIZE = 4
train_loop(NUM_EPOCHS, my_model, train_dataset, valid_dataset, train=True, valid=True,
batch_size=BATCH_SIZE, lr=LR, saveckpt=True, ckpt_name='ours', log_dir='ours', device_ids=device_ids,
(END)
the conda environment output is as below.
pip list
Package Version Editable project location
addict 2.4.0
aliyun-python-sdk-core 2.16.0
aliyun-python-sdk-kms 2.16.5
anykeystore 0.2
apex 0.9.10.dev0
audioread 3.0.1
av 9.1.0
bypy 1.8.9
certifi 2025.6.15
cffi 1.17.1
charset-normalizer 3.4.2
click 8.1.8
colorama 0.4.6
crcmod 1.7
cryptacular 1.6.2
cryptography 45.0.4
cycler 0.12.1
dataclasses 0.6
decorator 5.2.1
decord 0.6.0
defusedxml 0.7.1
dill 0.4.0
einops 0.3.2
filelock 3.14.0
flatbuffers 25.2.10
future 1.0.0
greenlet 3.1.1
hupper 1.12.1
idna 3.10
imageio 2.9.0
imgaug 0.4.0
importlib_metadata 8.5.0
importlib_resources 6.4.5
jmespath 0.10.0
joblib 1.0.1
kiwisolver 1.4.7
kornia 0.5.11
librosa 0.9.1
llvmlite 0.41.1
lmdb 1.3.0
lws 1.2.7
Markdown 3.7
markdown-it-py 3.0.0
MarkupSafe 2.1.5
matplotlib 3.3.4
mdurl 0.1.2
mmaction2 1.2.0 /home/boil/xgs/cv/mmaction2
mmcls 0.22.0
mmcv 1.4.8
mmcv-full 1.3.17
mmdet 2.23.0
model-index 0.1.11
mpmath 1.3.0
multiprocess 0.70.18
networkx 3.1
numba 0.58.0
numpy 1.21.0
oauthlib 3.3.1
onnx 1.11.0
onnxruntime 1.11.0
opencv-contrib-python 4.5.5.62
opencv-python 4.5.4.60
opendatalab 0.0.10
openmim 0.3.9
openxlab 0.1.2
ordered-set 4.1.0
oss2 2.17.0
packaging 24.2
pandas 1.2.4
PasteDeploy 3.1.0
pbkdf2 1.3
Pillow 9.0.1
pip 25.0.1
plaster 1.1.2
plaster-pastedeploy 1.0.1
platformdirs 4.3.6
pooch 1.8.2
protobuf 3.20.3
pycocotools 2.0.7
pycparser 2.22
pycryptodome 3.23.0
Pygments 2.19.2
pyparsing 3.1.4
pyramid 2.0.2
pyramid-mailer 0.15.1
python-dateutil 2.9.0.post0
python3-openid 3.2.0
pytz 2023.4
PyWavelets 1.4.1
PyYAML 6.0.2
repoze.sendmail 4.4.1
requests 2.28.2
requests-oauthlib 2.0.0
requests-toolbelt 1.0.0
resampy 0.4.3
rich 13.4.2
scikit-image 0.18.1
scikit-learn 1.1.3
scipy 1.6.2
seaborn 0.11.1
setuptools 60.2.0
shapely 2.0.7
six 1.17.0
soundfile 0.13.1
SQLAlchemy 2.0.41
sympy 1.8
tabulate 0.9.0
tensorboardX 2.5
tensorrt 0.0.1
terminaltables 3.1.10
threadpoolctl 3.5.0
tifffile 2023.7.10
timm 0.4.12
tomli 2.2.1
torch 1.7.0+cu110
torchaudio 0.7.0
torchvision 0.8.1+cu110
tqdm 4.65.0
transaction 5.0
translationstring 1.4
typing_extensions 4.12.2
tzdata 2025.2
urllib3 1.26.20
velruse 1.1.1
venusian 3.1.1
WebOb 1.8.9
wheel 0.45.1
WTForms 3.1.2
wtforms-recaptcha 0.3.2
yapf 0.43.0
zipp 3.20.2
zope.deprecation 5.0
zope.interface 7.2
zope.sqlalchemy 3.1