GAE + GCE support

[stephenplusplus]

GAE

GAE support is still underway so I'll leave this part out for now.

GCE

I created an instance:

$ gcloud compute instances create silliestcloud --scopes https://www.googleapis.com/auth/datastore https://www.googleapis.com/auth/userinfo.email https://www.googleapis.com/auth/devstorage.full_control

And initiate gcloud like this:

var gcloud = require('gcloud');

var dataset = new gcloud.datastore.Dataset();
var bucket = new gcloud.storage.Bucket({
  bucketName: 'sillycloud'
});

When accessing a file from my bucket, everything goes smoothly. However, when trying to run a query on my dataset, I get a 403:

Daily Limit for Unauthenticated Use Exceeded. Continued use requires signup.

I'm able to retrieve a token without an issue, but still receive that error after making the request. Any idea if this is a problem with my project/account, or a problem with gcloud?

After reading Authenticating from Google Compute Engine, I saw a line:

When you create a Google Compute Engine project, Google Compute Engine also creates a service account for that project. This service account authenticates the project to other Google services but you can also use the service account to authenticate your instances to other APIs. This is ideal for cases when you have applications running within instances that need to programmatically talk between services but don't need access to user data.

Any chance our need for the userinfo.email scope could qualify for "user data"?

[proppy]

@stephenplusplus did you enable the Google Cloud Datastore API for your project?

[stephenplusplus]

Yes, and I should mention I've been getting this error for the last couple days, but at first I was able to access without any errors. It also works if I specify the credentials manually:

new gcloud.datastore.Dataset({
  credentials: { /* contents of json key file */ }
});

[silvolu]

@stephenplusplus I now have a GCE instance running sillycloud, and I cannot reproduce your issue. I'll keep it around and monitor it for some days.

[stephenplusplus]

Hmm. Well, that's good to hear, since that means our GCE support wasn't compromised, but disappointing that I don't know how to fix.

I wonder if you tried making a change to see if you can surpass the limit that I'm exceeding. If you want to run an experiment, pasting the below as the getUsers function (https://github.com/stephenplusplus/sillycloud/blob/master/actions.js#L10) should run the query once every 100 ms until it reaches 20 attempts (as written, feel free to change timesToRun and intervalMs).

function getUsers(req, res) {
  var ran = 0;
  var timesToRun = 20;
  var intervalMs = 100;
  var query = dataset.createQuery(['Users']);
  var interval = setInterval(function() {
    if (++ran <= timesToRun) {
      dataset.runQuery(query, function(err, results) {
        if (ran === timesToRun) {
          _handleResponse(res)(err, results);
        }
      }
    } else {
      clearInterval(interval);
    }
  }, intervalMs);
}

Just an idea. I'm desperate to find a fix to this. Thanks for testing!

// edit: if you know of a less abusive way to get to the same ends, that's probably better :)

[stephenplusplus]

GCE resolved 👍

GAE still being worked on in #233.