'전체 글'에 해당되는 글 1803건

  1. 2019.05.20 [study] Unity-Technologies/ml-agents
  2. 2019.05.19 텐서보드 사용법
  3. 2019.05.19 ImportError: Could not find 'cudart64_90.dll'.
  4. 2019.05.19 Using TensorFlowSharp in Unity (Experimental)
  5. 2019.05.19 [ml-agents] Hyperparameters
  6. 2019.05.18 pkg_resources.ContextualVersionConflict: (Pillow 6.0.0 (c:\python\python36\lib\site-packages), Requirement.parse('Pillow<=5.4.1,>=4.2.1'), {'mlagents-envs'})

[study] Unity-Technologies/ml-agents

카테고리 없음 2019. 5. 20. 00:38
반응형

https://unity3d.com/kr/how-to/unity-machine-learning-agents

 

Learn how to use Unity Machine Learning Agents - Unity

The latest Unity Machine Learning Agents SDK is now available. Unity ML-Agents provides features for adding intelligent agents to your game, each acting with dynamic and engaging behavior. It’s cutting-edge tech, but our engineering team has made it as acc

unity3d.com

 

https://github.com/Unity-Technologies/ml-agents

 

Unity-Technologies/ml-agents

Unity Machine Learning Agents Toolkit. Contribute to Unity-Technologies/ml-agents development by creating an account on GitHub.

github.com

 

https://github.com/Unity-Technologies/ml-agents/blob/master/docs/Readme.md

 

Unity-Technologies/ml-agents

Unity Machine Learning Agents Toolkit. Contribute to Unity-Technologies/ml-agents development by creating an account on GitHub.

github.com

 

https://github.com/Unity-Technologies/ml-agents/blob/master/docs/Installation.md

 

Unity-Technologies/ml-agents

Unity Machine Learning Agents Toolkit. Contribute to Unity-Technologies/ml-agents development by creating an account on GitHub.

github.com

 

https://github.com/Unity-Technologies/ml-agents/blob/master/docs/Installation-Windows.md

 

Unity-Technologies/ml-agents

Unity Machine Learning Agents Toolkit. Contribute to Unity-Technologies/ml-agents development by creating an account on GitHub.

github.com

 

 

반응형
:

텐서보드 사용법

Unity3D 2019. 5. 19. 18:26
반응형

https://pythonkim.tistory.com/39

 

텐서보드 사용법

TensorBoard는 TensorFlow에 기록된 로그를 그래프로 시각화시켜서 보여주는 도구다. 1. TensorBoard 실행 tensorboard --logdir=/tmp/sample 루트(/) 폴더 밑의 tmp 폴더 밑의 sample 폴더에 기록된 로그를 보겠..

pythonkim.tistory.com

 

반응형

'Unity3D' 카테고리의 다른 글

IL2CPP  (0) 2019.06.04
에셋번들 실전 가이드 (AssetBundle Best Practices)  (0) 2019.06.03
ImportError: Could not find 'cudart64_90.dll'.  (0) 2019.05.19
Using TensorFlowSharp in Unity (Experimental)  (0) 2019.05.19
[ml-agents] Hyperparameters  (0) 2019.05.19
:

ImportError: Could not find 'cudart64_90.dll'.

Unity3D 2019. 5. 19. 17:39
반응형

https://developer.nvidia.com/cuda-90-download-archive?target_os=Windows&target_arch=x86_64

 

CUDA Toolkit 9.0 Downloads

*/

developer.nvidia.com

ImportError: Could not find 'cudart64_90.dll'. TensorFlow requires that this DLL be installed in a directory that is named in your %PATH% environment variable. Download and install CUDA 9.0 from this URL: https://developer.nvidia.com/cuda-toolkit

 

CUDA Toolkit

The NVIDIA® CUDA® Toolkit provides a development environment for creating high performance GPU-accelerated applications. With the CUDA Toolkit, you can develop, optimize and deploy your applications on GPU-accelerated embedded systems, desktop workstations

developer.nvidia.com

 

(build_info.cudnn_dll_name, build_info.cudnn_version_number))
ImportError: Could not find 'cudnn64_7.dll'. TensorFlow requires that this DLL be installed in a directory that is named in your %PATH% environment variable. Note that installing cuDNN is a separate step from installing CUDA, and this DLL is often found in a different directory from the CUDA DLLs. You may install the necessary DLL by downloading cuDNN 7 from this URL: https://developer.nvidia.com/cudnn

 

NVIDIA cuDNN

*/

developer.nvidia.com

cudart64_90.dll 이 있는 폴더 환경변수 추가

 

반응형
:

Using TensorFlowSharp in Unity (Experimental)

Unity3D 2019. 5. 19. 16:12
반응형

https://github.com/salepaun/ML-agents/blob/master/docs/Using-TensorFlow-Sharp-in-Unity.md

 

salepaun/ML-agents

Contribute to salepaun/ML-agents development by creating an account on GitHub.

github.com

 

반응형

'Unity3D' 카테고리의 다른 글

텐서보드 사용법  (0) 2019.05.19
ImportError: Could not find 'cudart64_90.dll'.  (0) 2019.05.19
[ml-agents] Hyperparameters  (0) 2019.05.19
Tower Defense Template (분해)  (0) 2019.05.03
LayerMask  (0) 2019.05.01
:

[ml-agents] Hyperparameters

Unity3D 2019. 5. 19. 15:48
반응형

https://github.com/Unity-Technologies/ml-agents/blob/master/docs/Training-PPO.md

 

Unity-Technologies/ml-agents

Unity Machine Learning Agents Toolkit. Contribute to Unity-Technologies/ml-agents development by creating an account on GitHub.

github.com

1
2
3
4
5
6
7
8
9
10
BallBrain:
    normalize: true    #정규화 되었는가? (학습성능향상)
    gamma: 0.90    #미래의 보상을 현재에 적용할때 할인률
 
    #lambda
    #미래의 보상을 평가 할때 이전까지의 보상을 기준으로 하는 정도 
    #낮으면 지금까지의 보상을 기준으로 미래의 보상을 평가하게 되고, 지금까지의 경향을 유지하는 방향으로 굳어짐 
    #높으면 이전까지의 값을 기준으로 하는게 아니라 미래의 값을 그대로 받아 들이기 때문에 높은 다양성을 가지게 됨
    #너무 적으면 경향이 너무 굳어지고, 너무 높으면 다양성을 커지고 안정성은 떨어짐 
    lambda: 0.99 
 
 

 

Gamma 
gamma corresponds to the discount factor for future rewards. 
This can be thought of as how far into the future the agent should care about possible rewards. 
In situations when the agent should be acting in the present in order to prepare for rewards in the distant future, this value should be large. 
In cases when rewards are more immediate, it can be smaller.



감마 

미래의 보상에 대한 할인율 

감마는 미래의 보상에 대한 할인 요인에 해당합니다. 
이는 에이전트가 가능한 보상에 대해 얼마나 신경 써야 하는지를 생각할 수 있습니다. 
먼 미래에 보상을 준비하기 위해 대리인이 현재 행동해야하는 상황에서는이 값이 커야합니다. 
보상이 더 즉각적인 경우에는 더 작을 수 있습니다.



Lambda

lambd corresponds to the lambda parameter used when calculating the Generalized Advantage Estimate (GAE). 
This can be thought of as how much the agent relies on its current value estimate when calculating an updated value estimate. 
Low values correspond to relying more on the current value estimate (which can be high bias), 
and high values correspond to relying more on the actual rewards received in the environment (which can be high variance). 
The parameter provides a trade-off between the two, and the right value can lead to a more stable training process.




lambd는 GAE (Generalized Advantage Estimate)를 계산할 때 사용되는 람다 매개 변수에 해당합니다. 
이는 업데이트 된 가치 추정치를 계산할 때 상담원이 현재의 가치 견적에 얼마나 의존 하는지를 생각할 수 있습니다. 
낮은 값은 현재 값 추정 (높은 바이어스가 될 수 있음)에 더 많이 의존하고 높은 값은 환경에서받는 실제 보상 (높은 분산 일 수 있음)에 더 많이 의존하는 것과 같습니다. 
매개 변수는 둘 사이의 균형을 제공하며 올바른 값은보다 안정적인 교육 프로세스로 이어질 수 있습니다.

반응형

'Unity3D' 카테고리의 다른 글

ImportError: Could not find 'cudart64_90.dll'.  (0) 2019.05.19
Using TensorFlowSharp in Unity (Experimental)  (0) 2019.05.19
Tower Defense Template (분해)  (0) 2019.05.03
LayerMask  (0) 2019.05.01
world, screen, viewport  (0) 2019.04.23
:

pkg_resources.ContextualVersionConflict: (Pillow 6.0.0 (c:\python\python36\lib\site-packages), Requirement.parse('Pillow<=5.4.1,>=4.2.1'), {'mlagents-envs'})

Python 2019. 5. 18. 00:18
반응형

 

https://github.com/Unity-Technologies/ml-agents/issues/1939

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
 
(base) C:\Users\smile>activate ml-agents  
 
(ml-agents) C:\Users\smile>mlagent-learn --help  
'mlagent-learn'은(는) 내부 또는 외부 명령, 실행할 수 있는 프로그램, 또는  
배치 파일이 아닙니다.  
 
(ml-agents) C:\Users\smile>d:  
 
(ml-agents) D:\>cd workspace  
 
(ml-agents) D:\workspace>cd unity  
 
(ml-agents) D:\workspace\unity>cd git  
 
(ml-agents) D:\workspace\unity\git>cd ml-agents  
 
(ml-agents) D:\workspace\unity\git\ml-agents>cd ml-agents  
 
(ml-agents) D:\workspace\unity\git\ml-agents\ml-agents>dir  
 D 드라이브의 볼륨: 새 볼륨  
 볼륨 일련 번호: E294-BC0E  
 
 D:\workspace\unity\git\ml-agents\ml-agents 디렉터리  
 
2019-05-17  오후 10:56     
 
          .  
2019-05-17  오후 10:56     
          ..  
2019-05-17  오후 10:18     
          mlagents  
2019-05-18  오전 12:03     
          mlagents.egg-info  
2019-05-17  오후 10:18             1,269 README.md  
2019-05-17  오후 10:18             1,553 setup.py  
               2개 파일               2,822 바이트  
               4개 디렉터리  1,496,122,159,104 바이트 남음  
 
(ml-agents) D:\workspace\unity\git\ml-agents\ml-agents>mlagents --help  
'mlagents'은(는) 내부 또는 외부 명령, 실행할 수 있는 프로그램, 또는  
배치 파일이 아닙니다.  
 
(ml-agents) D:\workspace\unity\git\ml-agents\ml-agents>mlagents-learn --help  
Traceback (most recent call last):  
  File "c:\python\python36\lib\site-packages\pkg_resources\__init__.py", line 581in _build_master  
    ws.require(__requires__)  
  File "c:\python\python36\lib\site-packages\pkg_resources\__init__.py", line 898in require  
    needed = self.resolve(parse_requirements(requirements))  
  File "c:\python\python36\lib\site-packages\pkg_resources\__init__.py", line 789in resolve  
    raise VersionConflict(dist, req).with_context(dependent_req)  
pkg_resources.ContextualVersionConflict: (Pillow 6.0.0 (c:\python\python36\lib\site-packages), Requirement.parse('Pillow<=5.4.1,>=4.2.1'), {'mlagents-envs'})  
 
During handling of the above exception, another exception occurred:  
 
Traceback (most recent call last):  
  File "C:\Python\Python36\Scripts\mlagents-learn-script.py", line 6in   
    from pkg_resources import load_entry_point  
  File "c:\python\python36\lib\site-packages\pkg_resources\__init__.py", line 3126in   
    @_call_aside  
  File "c:\python\python36\lib\site-packages\pkg_resources\__init__.py", line 3110in _call_aside  
    f(*args, **kwargs)  
  File "c:\python\python36\lib\site-packages\pkg_resources\__init__.py", line 3139in _initialize_master_working_set  
    working_set = WorkingSet._build_master()  
  File "c:\python\python36\lib\site-packages\pkg_resources\__init__.py", line 583in _build_master  
    return cls._build_from_requirements(__requires__)  
  File "c:\python\python36\lib\site-packages\pkg_resources\__init__.py", line 596in _build_from_requirements  
    dists = ws.resolve(reqs, Environment())  
  File "c:\python\python36\lib\site-packages\pkg_resources\__init__.py", line 789in resolve  
    raise VersionConflict(dist, req).with_context(dependent_req)  
pkg_resources.ContextualVersionConflict: (Pillow 6.0.0 (c:\python\python36\lib\site-packages), Requirement.parse('Pillow<=5.4.1,>=4.2.1'), {'mlagents-envs'})  
 
(ml-agents) D:\workspace\unity\git\ml-agents\ml-agents>pip3 uninstall pillow==6.0.0  
Uninstalling Pillow-6.0.0:  
  Would remove:  
    c:\python\python36\lib\site-packages\pil\*  
    c:\python\python36\lib\site-packages\pillow-6.0.0.dist-info\*  
Proceed (y/n)? y  
  Successfully uninstalled Pillow-6.0.0  
 
(ml-agents) D:\workspace\unity\git\ml-agents\ml-agents>pip3 install pillow==5.0.0  
Collecting pillow==5.0.0  
  Downloading https://files.pythonhosted.org/packages/00/43/e27783aad62ef61d1ec296ca1c14699a1dd713642a043a7de8b3e4b6feea/Pillow-5.0.0-cp36-cp36m-win_amd64.whl (1.6MB)  
     |████████████████████████████████| 1.6MB 939kB/s  
Installing collected packages: pillow  
Successfully installed pillow-5.0.0  
 
(ml-agents) D:\workspace\unity\git\ml-agents\ml-agents>mlagents-learn --help  
 
 
                        ▄▄▄▓▓▓▓  
                   ╓▓▓▓▓▓▓█▓▓▓▓▓  
              ,▄▄▄m▀▀▀'  ,▓▓▓▀▓▓▄                           ▓▓▓  ▓▓▌  
            ▄▓▓▓▀'      ▄▓▓▀  ▓▓▓      ▄▄     ▄▄ ,▄▄ ▄▄▄▄   ,▄▄ ▄▓▓▌▄ ▄▄▄    ,▄▄  
          ▄▓▓▓▀        ▄▓▓▀   ▐▓▓▌     ▓▓▌   ▐▓▓ ▐▓▓▓▀▀▀▓▓▌ ▓▓▓ ▀▓▓▌▀ ^▓▓▌  ╒▓▓▌  
        ▄▓▓▓▓▓▄▄▄▄▄▄▄▄▓▓▓      ▓▀      ▓▓▌   ▐▓▓ ▐▓▓    ▓▓▓ ▓▓▓  ▓▓▌   ▐▓▓▄ ▓▓▌  
        ▀▓▓▓▓▀▀▀▀▀▀▀▀▀▀▓▓▄     ▓▓      ▓▓▌   ▐▓▓ ▐▓▓    ▓▓▓ ▓▓▓  ▓▓▌    ▐▓▓▐▓▓  
          ^█▓▓▓        ▀▓▓▄   ▐▓▓▌     ▓▓▓▓▄▓▓▓▓ ▐▓▓    ▓▓▓ ▓▓▓  ▓▓▓▄    ▓▓▓▓`  
            '▀▓▓▓▄      ^▓▓▓  ▓▓▓       └▀▀▀▀ ▀▀ ^▀▀    `▀▀ `▀▀   '▀▀    ▐▓▓▌  
               ▀▀▀▀▓▄▄▄   ▓▓▓▓▓▓,                                      ▓▓▓▓▀  
                   `▀█▓▓▓▓▓▓▓▓▓▌  
                        ¬`▀▀▀█▓  
 
 
    Usage:  
      mlagents-learn  [options]  
      mlagents-learn --help  
 
    Options:  
      --env=               Name of the Unity executable [default: None].  
      --curriculum=   Curriculum json directory for environment [default: None].  
      --keep-checkpoints=     How many model checkpoints to keep [default: 5].  
      --lesson=               Start learning from this lesson [default: 0].  
      --load                     Whether to load the model or randomly initialize [default: False].  
      --run-id=            The directory name for model and summary statistics [default: ppo].  
      --num-runs=             Number of concurrent training sessions [default: 1].  
      --save-freq=            Frequency at which to save model [default: 50000].  
      --seed=                 Random seed used for training [default: -1].  
      --slow                     Whether to run the game at training speed [default: False].  
      --train                    Whether to train model, or only run inference [default: False].  
      --base-port=            Base port for environment communication [default: 5005].  
      --num-envs=             Number of parallel environments to use for training [default: 1]  
      --docker-target-name=  Docker volume to store training-specific files [default: None].  
      --no-graphics              Whether to run the environment in no-graphics mode [default: False].  
      --debug                    Whether to run ML-Agents in debug mode with detailed logging [default: False].  
 
 
(ml-agents) D:\workspace\unity\git\ml-agents\ml-agents>
 
 
반응형

'Python ' 카테고리의 다른 글

mac python 여러버전  (0) 2022.11.28
특수문자  (0) 2019.06.12
python 설치 (windows 10)  (0) 2019.01.21
: