i/o timeout with mgo and mongodb

mongodb go mgo
SRC picture SRC · Jul 9, 2014 · Viewed 9.3k times · Source

I am running a map-reduce job from mgo. It runs on a collection with a little more than 3.5M records. For some reasons right now I can not port this to aggregation; may be later. So, map-reduce is the thing I am looking forward to. This job, when I run it from the original js files I have created to test the code and output, runs fine. I tried to put the map and reduce code inside two strings and then tried to call the mgo.MapReduce to do the map-reduce for me where I am writing the output in a different collection. And it gives me

read tcp 127.0.0.1:27017: i/o timeout

Though, as the job has been fired in back-ground it is still running. Now according to this thread here --- http://grokbase.com/t/gg/mgo-users/1396d9wyk3/i-o-timeout-in-statistics-generation-upsert

It is easy to solve by calling the session.SetSocketTimeout but I do not want to do this as the total number of documents on which this map-reduce will run will vary and thus, I believe, the time. So, I will never be able to solve the problem by that way I believe.

What are the other ways that I might have?

Please help me

Answer

OneOfOne picture OneOfOne · Jul 9, 2014

Moving my comment to an answer.

I believe the only way to fix this is simply setting the socket timeout to something ridiculously high, for example:

session.SetSocketTimeout(1 * time.Hour)

Related questions

server returned error on SASL authentication step: Authentication failed

The following is my MongoDB connection dial from GoLang. But it's returning a panic "server returned error on SASL authentication step: Authentication failed.". My username, password, hostAddrs and dbName are correct. What am I missing here? dbName: = os.Getenv("ENV_…

Read More
How do you select all records from a mongodb collection in golang using mgo

In MongoDB doing something like db.mycollection.find() returns all documents in a collection. When working in GoLang using the package labix.org/v2/mgo and I do for example: query := db.C("client").Find(); It complains that it requires …

Read More
Golang/mgo: How can I ask MongoDB to use current time in a field?

I have this struct that matches the types of a MongoDB collection I'm using: type AppInstance struct { Id bson.ObjectId "_id,omitempty" Url string Priority int LastSeen string } I want the LastSeen field to hold the time of the last …

Read More