{"id":2268,"date":"2010-06-10T19:46:00","date_gmt":"2010-06-10T19:46:00","guid":{"rendered":"https:\/\/ikaisays.com\/?p=2268"},"modified":"2021-04-20T19:51:03","modified_gmt":"2021-04-20T19:51:03","slug":"using-the-bulkloader-with-java-app-engine","status":"publish","type":"post","link":"https:\/\/ikaisays.com\/2010\/06\/10\/using-the-bulkloader-with-java-app-engine\/","title":{"rendered":"Using the bulkloader with Java App Engine"},"content":{"rendered":"\n<p>The latest release of the\u00a0<a href=\"http:\/\/code.google.com\/appengine\/docs\/python\/tools\/uploadingdata.html\">datastore bulkloader<\/a>\u00a0greatly simplifies import and export of data from App Engine applications for developers. We\u2019ll go through a step by step example for using this tool with a Java application. Note that only setting up\u00a0<a href=\"http:\/\/code.google.com\/appengine\/articles\/remote_api.html\">Remote API<\/a>\u00a0is Java specific \u2013 everything can be used with Python applications. Unlike certain phone companies, this is one store that doesn\u2019t care what language your application is written in.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Checking for our Prerequisites:<\/h2>\n\n\n\n<p>If you already have Python 2.5.x and the Python SDK installed, skip this section.<\/p>\n\n\n\n<p>First off, we\u2019ll need to download the Python SDK. This example assumes we have Python version 2.5.x installed. If you\u2019re not sure what version you have installed, open up a terminal and type \u201cpython\u201d. This opens up a Python REPL, with the first line displaying the version of Python you\u2019re using. Here\u2019s example output:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>Python 2.5.1 (r251:54869, Apr 18 2007, 22:08:04)\n&#91;GCC 4.0.1 (Apple Computer, Inc. build 5367)] on darwin\nType \"help\", \"copyright\", \"credits\" or \"license\" for more information.\n>>><\/code><\/pre>\n\n\n\n<p>(Yes, Pythonistas, the version on my laptop is ooooooooold).<\/p>\n\n\n\n<p>Download the Python SDK from\u00a0<a href=\"https:\/\/web.archive.org\/web\/20201217181823\/http:\/\/code.google.com\/appengine\/downloads.html\">the following link<\/a>.\u00a0As of the writing of this post, the newest version is 1.3.4:\u00a0<a href=\"http:\/\/googleappengine.googlecode.com\/files\/google_appengine_1.3.4.zip\">Direct link<\/a>.<\/p>\n\n\n\n<p>Unzip this file. It\u2019ll be easier for you if you place this in your path. Linux and OS X users will append this in their\u00a0<strong>~\/.bash_profile<\/strong>:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>PATH=\"\/path\/to\/where\/you\/unzipped\/appengine:${PATH}\"\nexport PATH<\/code><\/pre>\n\n\n\n<p>To test that everything is working, type:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>appcfg.py<\/code><\/pre>\n\n\n\n<p>You\u2019ll see a page of usage commands that starts out like this:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>Usage: appcfg.py &#91;options] &lt;action>\n \nAction must be one of:\ncreate_bulkloader_config: Create a bulkloader.yaml from a running application.\ncron_info: Display information about cron jobs.\ndownload_data: Download entities from datastore.\nhelp: Print help for a specific action.\nrequest_logs: Write request logs in Apache common log format.\nrollback: Rollback an in-progress update.\nupdate: Create or update an app version.\nupdate_cron: Update application cron definitions.\nupdate_dos: Update application dos definitions.\nupdate_indexes: Update application indexes.\nupdate_queues: Update application task queue definitions.\nupload_data: Upload data records to datastore.\nvacuum_indexes: Delete unused indexes from application.\nUse 'help &lt;action>' for a detailed description.<\/code><\/pre>\n\n\n\n<p>\u2026. (and so forth)<\/p>\n\n\n\n<p>Now we can go ahead and start using the bulkloader.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The latest release of the\u00a0datastore bulkloader\u00a0greatly simplifies import and export of data from App Engine applications for developers. We\u2019ll go through a step by step &#8230; <a title=\"Using the bulkloader with Java App Engine\" class=\"read-more\" href=\"https:\/\/ikaisays.com\/2010\/06\/10\/using-the-bulkloader-with-java-app-engine\/\" aria-label=\"More on Using the bulkloader with Java App Engine\">Read More<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_generate-full-width-content":""},"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/ikaisays.com\/wp-json\/wp\/v2\/posts\/2268"}],"collection":[{"href":"https:\/\/ikaisays.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ikaisays.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ikaisays.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ikaisays.com\/wp-json\/wp\/v2\/comments?post=2268"}],"version-history":[{"count":1,"href":"https:\/\/ikaisays.com\/wp-json\/wp\/v2\/posts\/2268\/revisions"}],"predecessor-version":[{"id":2269,"href":"https:\/\/ikaisays.com\/wp-json\/wp\/v2\/posts\/2268\/revisions\/2269"}],"wp:attachment":[{"href":"https:\/\/ikaisays.com\/wp-json\/wp\/v2\/media?parent=2268"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ikaisays.com\/wp-json\/wp\/v2\/categories?post=2268"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ikaisays.com\/wp-json\/wp\/v2\/tags?post=2268"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}