How long does it take an item to be ready for semantic search?
I added a few simple documents using curl like this:
curl -D - -X PUT -u [username]:[password] -u '{"label":"IBM News","parts":[{"name":"excerpt","data":"IBM announced today a new cognitive system..."}]}' 'https://gateway.watsonplatform.net/concept-insights-beta/api/v1/corpus/[my user name]/mike/ibmnews'
Then got a success response:
HTTP/1.1 201 Created
Im unable to use any of the searchable api on my corpus, everything comes back as:
{"error":"empty"}
When I check status of the document using GET /v1/searchable/{user}/{corpus}/{documentid}, I get:
{"stage":"annotate","status":"queued","timestamp":"2015-05-30T13:32:09.155Z"}
The same for documents I added yesterday. How long does it take for them to become ready?
Another thing is if I try to see how this document is related to a wiki concept using GET /v1/searchable/{user}/{corpus}/{documentid}, the stage changes to the following:
{"stage":"compute","status":"error","timestamp":"2015-05-30T13:28:31.229Z","lasterror":"empty"}
I'm guessing this might be because it is not yet annotated with concepts? If this is the case, is the document still in progress of being annotated? Or is this result permanent and the document has to be updated? How long until it becomes searchable? Is this supposed to be a long process or am I doing something wrong? Or should just accept this as a beta thing...
doitdoitdoit:
Thanks for the question!
The time to annotation (which is the first stage of our system) and the time to being "searchable" are both a function of the load in the beta system.
The GET command that you are trying which returns with an error status though means that the searchable did go through the machinery of undergoing annotations and indexing but somehow this concluded with an error. This sometimes happen when the JSON of the searchable itself was not constructed properly - our error messages are not as rich as they should be.
I do not know for a fact though that this is the case for your searchable. We would be very happy to work with you to track down what is happening with your submission. Let us know if you want to follow through with the offer.
Thanks! I'd appreciate any help. I'm really interested in this service and would like to know more about it.
It did end up going through (3 days since entering it). Other requests took anywhere from 2 hours to a day.