Edit big data file share input datasets

In the big data file share manifest editor, you can view a selected big data file share and the datasets that have been successfully registered in it. When you select a dataset from the editor drop-down menu, the corresponding parameters are populated. For details about each option on this dialog box, see editing parameters in big data file shares. To edit dataset parameters, do the following:

Regenerate the manifest for a big data file share

After a big data file share is created and a manifest is generated, a regenerate manifest button appears for each entry on the Registered Data Stores dialog box.

You can regenerate a manifest if you add new data or if you upload a hints file using the edit resource. The hints file provides specifications that are used when regenerating the manifest.

Dataset selector

A manifest is composed of one or more datasets. The number of datasets is dependent on the number of folders in your big data file share location. When you open the manifest manager, you can view the datasets that have been successfully registered in your big data file share. When you select a dataset from the drop-down menu, the dataset parameters are populated with the dataset information.

If you expected to find more datasets in your manifest or are missing any, do the following:

• Verify that you correctly registered the top-level folder. For more information, see Register your data with ArcGIS Server Manager.
• Confirm that your input data is in an allowable format, such as a collection of delimited files, shapefiles, Parquet, or Optimized Row Columnar (ORC).
• Ensure that the schema of your input dataset of interest is consistent for a collection of files (all files in a single dataset must have the same fields).

Fields

The fields section lists all of the fields in a dataset. When you select a dataset, you can see the following for each field:

• The name of the field
• The field type

The field name and type can be modified for delimited files. If you are modifying more than one field name, it is recommended that you use a hints file.

If the input dataset is a delimited file, there are multiple parameters that can be modified in the manifest in ArcGIS Server Manager.

Geometry

The geometry section lists the type of geometry and how it is represented. The following table outlines the available options, with notes for changes you can make, depending on the input dataset type:

Geometry parameters

Time

The time section outlines how time is represented. The following table outlines the available options, with notes for changes you can make, depending on the input dataset type. Time options are the same for all data types, except where noted.

Time parameters

Dataset format

The dataset format section outlines the format the data is in. Data may be in one of the following formats:

• Shapefile (.shp)
• Delimited file (for example, .csv)
• Parquet file
• ORC file

The available parameters differ depending on the dataset. For shapefiles, ORC, and Parquet files, the only parameter is the file type, which cannot be modified. If the input dataset is a delimited file, multiple parameters can be modified. To modify values for a delimited file, use a hints file and regenerate the manifest. These parameters are outlined in the following table:

Dataset formats

Output template selector

A big data file share is optionally composed of one or more templates. The number of templates is determined by the different formats to which you want to write results. When you open the output template manager, you can view the templates that have been successfully registered in your big data file share. When you select a template from the drop-down menu, the template parameters are populated with the output formatting information. If you want to add a new template, select the Add template option, and select the type and name of the new template. If you want to delete a template, select it from the template selector, and select Delete template. You can modify an existing template by selecting it and modifying any of the sections below as needed.

Geometry

The geometry section lists how you want the output geometry to be formatted for each geometry type (point, line, polygon). There are two parts to determining the output geometry:

• The spatial reference—You can leave it empty, and it will use the tool results (default). Optionally, provide a WKID or WKT string, and all results will be projected to that spatial reference. This value is shared across all output geometries.
• The geometry formatting type and fields—This is described in more detail below.

Output geometry formats

Geometry type	Output fields	Delimited files	Shapefiles	ORC files	Parquet files
XYZ—An X, Y, and optionally Z field. This option is only available for points.	By default, three new fields are created, named X, Y, and Z. You can optionally change these field names.
WKT	By default, one new field named Geometry is created. You can optionally change the output field names.
GeoJSON	By default, one new field named Geometry is created. You can optionally change the output field names.
EsriJSON	By default, one new field named Geometry is created. You can optionally change the output field names.
SHP	By default, one new field named Geometry is created. You can optionally change the output field names.
WKB	By default, one new field named Geometry is created. You can optionally change the output field names.
Shape Buffer	By default, one new field named Geometry is created. You can optionally change the output field names.

Time

The time section outlines how output time is represented. Formatting time requires the following information:

• Formatting for both instants and intervals.
• The field names to which time is written.
• The format (String or Date) in which time is written. Note that delimited files can only be formatted with string.
• For intervals, which fields represent the start and end time.

Time formatting is the same as for input big data files. See Time formats in big data file shares.

Dataset format

The dataset format section outlines the output format to which the data is written. Data may be in one of the following formats:

• Shapefile (.shp)
• Delimited file (for example, .csv)
• Parquet file
• ORC file

The available parameters differ depending on the dataset. For shapefiles, ORC, and Parquet files, the only parameter is the file type, which cannot be modified. If the input dataset is a delimited file, multiple parameters can be modified in ArcGIS Server Manager. These parameters are outlined in the following table:

Dataset formats