Now available on Stack Overflow for Teams! AI features where you work: search, IDE, and chat
Share, comment, bookmark or report
1. onnxruntime 1.11.1 supports Python 3.6 (see the middle of the left column). Later versions don't support 3.6. I guess you use Python 3.6. To install a later version of onxruntime upgrade Python. All versions up to the current 1.15.1 requires at least 3.7; 1.15.0 and 1.15.1 don't provide wheels for Python 3.7, only for 3.8+.
Share, comment, bookmark or report
I ran into exactly the same issue and your pointer to onnxruntime-gpu and torch compatibility put me on the right track. In my case, updating to the ...
Share, comment, bookmark or report
If you want to build onnxruntime environment for GPU use following simple steps. Step 1: uninstall your current onnxruntime. >> pip uninstall onnxruntime. Step 2: install GPU version of onnxruntime environment. >>pip install onnxruntime-gpu. Step 3: Verify the device support for onnxruntime environment. >> import onnxruntime as rt.
Share, comment, bookmark or report
I'm converting a customized Pytorch model to ONNX. However, when loading it with ONNXRuntime, I've encountered an error as follows: onnxruntime.capi.onnxruntime ...
Share, comment, bookmark or report
import onnxruntime as ort ort_session = ort.InferenceSession("yolov5.onnx", providers=["CUDAExecutionProvider"]) # compute ONNX Runtime output prediction ort_inputs = {ort_session.get_inputs()[0].name: resized} ort_outs = ort_session.run(None, ort_inputs) HERE I HAVE TENSOR WITH ALL THE BOUNDING BOXES # Keep only interesting bounding boxes
Share, comment, bookmark or report
Someone help. My code won't run because it says"onnxruntime is not defined". Here are my imports: %matplotlib inline import torch import onnxruntime from torch import nn import torch.onnx as onnx import torchvision.models as models from torchvision import datasets from torchvision.transforms import ToTensor and the code cell I'm trying to run
Share, comment, bookmark or report
Short: I run my model in pycharm and it works using the GPU by way of CUDAExecutionProvider. I create an exe file of my project using pyinstaller and it doesn't work anymore. Long & Detail: In my
Share, comment, bookmark or report
I have installed onnxruntime-gpu library in my environment pip install onnxruntime-gpu==1.2.0 nvcc --version output Cuda compilation tools, release ...
Share, comment, bookmark or report
After countless tries, I got confused in this issue but finally solved it. Now, back to the initial problem that made me lose my hair: CUDA does not seem to be used when I run my model with pytorch...
Share, comment, bookmark or report
Comments