일부 과학 컴퓨팅 프로젝트에서 그리드 검색을 수행하고 있는데 파일 이름에 매개변수가 포함된 로그 파일을 많이 얻었습니다.
$ ls -l | wc -l
38210
$ ls -l | tail
-rw-rw-r-- 1 qys wheel 1070 Jul 20 15:01 gmm_dim96_aelr0.01_ufactor100_K8_R8_lr1_lambda0_kappa0.25.txt
-rw-rw-r-- 1 qys wheel 1070 Jul 20 15:00 gmm_dim96_aelr0.01_ufactor100_K8_R8_lr1_lambda0_kappa0.5.txt
-rw-rw-r-- 1 qys wheel 1070 Jul 20 15:01 gmm_dim96_aelr0.01_ufactor100_K8_R8_lr1_lambda0_kappa0.75.txt
-rw-rw-r-- 1 qys wheel 1070 Jul 20 15:00 gmm_dim96_aelr0.01_ufactor100_K8_R8_lr1_lambda0_kappa0.txt
-rw-rw-r-- 1 qys wheel 1070 Jul 20 15:01 gmm_dim96_aelr0.01_ufactor100_K8_R8_lr1_lambda0_kappa1.txt
-rw-rw-r-- 1 qys wheel 981 Jul 20 15:06 gmm_dim96_aelr0.01_ufactor100_K8_R8_lr1_lambda1_kappa0.25.txt
-rw-rw-r-- 1 qys wheel 981 Jul 20 15:08 gmm_dim96_aelr0.01_ufactor100_K8_R8_lr1_lambda1_kappa0.5.txt
-rw-rw-r-- 1 qys wheel 981 Jul 20 15:08 gmm_dim96_aelr0.01_ufactor100_K8_R8_lr1_lambda1_kappa0.75.txt
-rw-rw-r-- 1 qys wheel 981 Jul 20 15:06 gmm_dim96_aelr0.01_ufactor100_K8_R8_lr1_lambda1_kappa0.txt
-rw-rw-r-- 1 qys wheel 984 Jul 20 15:08 gmm_dim96_aelr0.01_ufactor100_K8_R8_lr1_lambda1_kappa1.txt
각 파일은 다음과 같습니다.
$ cat gmm_dim96_aelr0.01_ufactor100_K8_R8_lr1_lambda1_kappa1.txt
GMM: epoch 0: train loss 662699.9375, valid accuracy 80.03%
GMM: epoch 1: train loss 662553.75, valid accuracy 79.92%
GMM: epoch 2: train loss 662446.1875, valid accuracy 79.77%
GMM: epoch 3: train loss 662429.5, valid accuracy 79.82%
GMM: epoch 4: train loss 662404.5625, valid accuracy 79.83%
GMM: epoch 5: train loss 662395.0625, valid accuracy 79.85%
GMM: epoch 6: train loss 662381.25, valid accuracy 79.85%
GMM: epoch 7: train loss 662370.25, valid accuracy 79.83%
GMM: epoch 8: train loss 662362.875, valid accuracy 79.86%
GMM: epoch 9: train loss 662353.6875, valid accuracy 79.84%
GMM: epoch 10: train loss 662343.4375, valid accuracy 79.83%
GMM: epoch 11: train loss 662335.0625, valid accuracy 79.83%
GMM: epoch 12: train loss 662325.5, valid accuracy 79.85%
GMM: epoch 13: train loss 662316.6875, valid accuracy 79.87%
GMM: epoch 14: train loss 662307.0625, valid accuracy 79.88%
GMM: epoch 15: train loss 662298.0625, valid accuracy 79.90%
GMM: end: test accuracy 80.38%
정밀도를 평가하여 매개변수 구성을 정렬하고 싶지만 grep다음 오류가 발생합니다.
$ grep 'GMM: epoch 15: ' gmm_*ufactor100*.txt | sort -k 9 -n -r | head
exec: Failed to execute process '/usr/bin/grep': the total size of the argument list and exported variables (2.1MB) exceeds the OS limit of 1MB.
더 큰 크기의 매개변수 목록을 허용하는 방법은 무엇입니까? 관련이 있는 경우를 대비해 macOS Monterey를 사용하고 있습니다.