[$250] Migration script

[jmgasper]

We need a Node script that I can run to move content from the current groups API (http://api.topcoder-dev.com/v3/groups) to a new groups API configuration.

General requirements

1. We don't want to lose any data, so if anything doesn't "match", we need to alert the caller and throw an error.
2. The endpoints for both the current groups API and the new groups API should be configurable. I'll be deploying this on Heroku for our own integration at some point in the future, and I'll want to migrate data from dev to this new Heroku instance.
3. To make things easier, it's alright to expect the caller to pass in an authentication token for use with the old API.

Member data should also be moved: http://api.topcoder-dev.com/v3/groups/20000000/members

For testing, you can login on dev with tonyj / appirio123

New functionality

The current groups ID in the old API is an int. We'd like to use UUIDs for the new groups API. Let's update the new groups API to support UUIDs for new data, with an optional mapping to the old ID. So, we'd potentially have two IDs for migrated data - an old ID and a new ID. Any new data that isn't migrated will only have the new ID.

Script

Here's a Ruby script that logs in, converts the token, and outputs the full list of groups.

Use either tonyj or tcwebservice with password appirio123

tc_service_test.rb.zip

[jmgasper]

Contest https://www.topcoder.com/challenges/30080163 has been created for this ticket.

This is an automated message for ghostar via Topcoder X

[jmgasper]

Contest https://www.topcoder.com/challenges/30080163 has been updated - the new changes has been updated for this ticket.

This is an automated message for ghostar via Topcoder X

[jmgasper]

Contest https://www.topcoder.com/challenges/30080163 has been updated - the new changes has been updated for this ticket.

This is an automated message for ghostar via Topcoder X

[jmgasper]

Contest https://www.topcoder.com/challenges/30080163 has been updated - the new changes has been updated for this ticket.

This is an automated message for ghostar via Topcoder X

[jmgasper]

Contest https://www.topcoder.com/challenges/30080163 has been updated - it has been assigned to hesibo.

This is an automated message for ghostar via Topcoder X

[hesibo]

1. It seems new groups API service will be deployed via Heroku. Can we access neo4j directly(outside Heroku instance)? Although we have User Node in neo4j but it is designed as outside resource. In other word, when a user register in TC, we need to insert a new User Node in neo4j outside such Heroku instance.
2. If an old user haven't join any group before, we can't migrate it if only retrieving data from old group API. So we need a file contains all userId(only user id) and migrate the User data via such file.

[jmgasper]

1. Yep, if you installed the GrapheneDB addon, you can get the connection details by running heroku config. You'll see details for the URL, username, and password as part of the Heroku instance config, which you can use to connect to the DB directly.

2. Ok - for now we'll leave that out of scope.

[hesibo]

I have created pull request for this issue. If you need automate test code for verification, please notice me.