[Answered ]-How do I exclude columns when exporting app engine data

by

0👍

✅

As you’ve observed, the bulkloader downloads the entire record using remote_api, then outputs only the fields you care about to the CSV. If you want to only download selected fields, you’ll have to write your own code to do this on the server-side – possibly by using the new Files API in a mapreduce, to write a file you can then download.

👤Nick Johnson

2👍

You can’t. The AppEngine datastore API, and the underlying GQL, only do two sorts of SELECT queries: __key__ only, and all fields. There’s no way of getting a subset of fields.

👤Daniel Roseman

0👍

Kind of late here but all I did in a similar situation was delete the unwanted property from the automatically generated bulkloader.yaml file.

Here is an example using the Google documentation to exclude the “account” property from the csv file. I use it for things like blobs and it works fine there too:

property_map:
- property: __key__
  external_name: key
  export_transform: transform.key_id_or_name_as_string
START DELETE
- property: account
  external_name: account
  # Type: Key Stats: 119 properties of this type in this kind.
  import_transform: transform.create_foreign_key('TODO: fill in Kind name')
  export_transform: transform.key_id_or_name_as_string
END DELETE
- property: invite_nonce
  external_name: invite_nonce
  # Type: String Stats: 19 properties of this type in this kind.
👤techkilljoy

Leave a comment