In TensorFlow, I can specify to use the CUDNN autotuner by setting: os.environ['TF_CUDNN_USE_AUTOTUNE'] = "1"
(currently enabled by default)”, which improves performance significantly over: os.environ['TF_CUDNN_USE_AUTOTUNE'] = "0"
(I am currently running on TensorCores on Volta GPUs).
However, I am unable to access this performance improvement when running pure Keras. Setting os.environ['TF_CUDNN_USE_AUTOTUNE'] = "1" does not have any effect. Is the autotuner disabled by default in Keras? How can I enable it?
Similar issue: #9321
In TensorFlow, I can specify to use the CUDNN autotuner by setting:
os.environ['TF_CUDNN_USE_AUTOTUNE'] = "1"(currently enabled by default)”, which improves performance significantly over:
os.environ['TF_CUDNN_USE_AUTOTUNE'] = "0"(I am currently running on TensorCores on Volta GPUs).
However, I am unable to access this performance improvement when running pure Keras. Setting
os.environ['TF_CUDNN_USE_AUTOTUNE'] = "1"does not have any effect. Is the autotuner disabled by default in Keras? How can I enable it?Similar issue: #9321