Top "Tensorflow-serving" questions

Xcode version must be specified to use an Apple CROSSTOOL

I try to build tensorflow-serving using bazel but I've encountered some errors during the building ERROR:/private/var/tmp/_bazel_…

tensorflow bazel tensorflow-serving
Tensorflow serving No versions of servable <MODEL> found under base path

I was following this tutorial to use tensorflow serving using my object detection model. I am using tensorflow object detection …

tensorflow deep-learning object-detection tensorflow-serving
How to load checkpoint and inference with C++ for tensorflow?

I have Tensorflow with python api and got these checkpoint model file: model.ckpt-17763.data-00000-of-00001 model.ckpt-17763.index model.…

c++ tensorflow deep-learning conv-neural-network tensorflow-serving
How to do batching in Tensorflow Serving?

Deployed Tensorflow Serving and ran test for Inception-V3. Works fine. Now, would like to do batching for serving for Inception-V3. …

python tensorflow tensorflow-serving
How can I use tensorflow serving for multiple models

How can I use multiple tensorflow models? I use docker container. model_config_list: { config: { name: "model1", base_path: "/tmp/…

docker tensorflow tensorflow-serving
Serving Keras Models With Tensorflow Serving

Right now we are successfully able to serve models using Tensorflow Serving. We have used following method to export the …

tensorflow keras tensorflow-serving serving dl4j
TensorFlow in production for real time predictions in high traffic app - how to use?

What is the right way to use TensorFlow for real time predictions in a high traffic application. Ideally I would …

python machine-learning tensorflow tensorflow-serving
Is it thread-safe when using tf.Session in inference service?

Now we have used TensorFlow to train and export an model. We can implement the inference service with this model …

python multithreading tensorflow tensorflow-serving
Tensorflow classifier.export_savedmodel (Beginner)

I know about the "Serving a Tensorflow Model" page https://www.tensorflow.org/serving/serving_basic but those functions assume …

tensorflow tensorflow-serving
How to deploy and serve prediction using TensorFlow from API?

From google tutorial we know how to train a model in TensorFlow. But what is the best way to save …

python tensorflow tensorflow-serving