Public JSON / HTTP
Fetch a public JSON or GeoJSON API response
Custom Streaming + One-shot
Fetch a public JSON or GeoJSON API response. Use this for public endpoints when there is no dedicated connector yet.
Technical details
Authentication ▾
Contact us for setup details.
Ingestion ▾
Mode: Streaming + One-shot
Tools exposed (2) ▾
http/get_public_json
Fetch a public JSON or GeoJSON API response. Use this for public endpoints when there is no dedicated connector yet.
upsert_bento_get_public_json
Create or update a recurring public JSON or GeoJSON connector. Public APIs only; no tenant secrets or OAuth.
Inputs ▾
http/get_public_json
| Name | Type | Required | Description |
|---|---|---|---|
| dashboardId | string | no | Target dashboard/initiative ID. Omit to use the current dashboard. |
| url | string | yes | Public JSON or GeoJSON endpoint URL. |
| method | string | no | HTTP method. Default: GET. GET POST |
| authPreset | string | no | Shared platform auth preset for public APIs. Use 'none' for unauthenticated endpoints. none api_data_gov noaa_token census_api_key bls_api_key socrata_app_token |
| query | object | no | Optional query params as {key: value} for the request. |
Nested schema for queryNo inputs. | |||
| headers | object | no | Optional non-secret request headers as {key: value} for public APIs. |
Nested schema for headersNo inputs. | |||
| body | object | no | Optional JSON body for POST requests. |
Nested schema for bodyNo inputs. | |||
| recordPath | string | no | Dot path to the array of result records inside the JSON response, e.g. 'results' or 'response.data'. |
| filter_paths | string[] | no | Optional glob paths to reduce the response returned to the model. |
| paginationType | string | no | Pagination strategy for the one-shot fetch. none offset cursor link_header |
| paginationLimitParam | string | no | Limit param name for offset pagination. |
| paginationOffsetParam | string | no | Offset param name for offset pagination. |
| paginationCursorParam | string | no | Cursor query param name for cursor pagination. |
| paginationNextCursorPath | string | no | Response path containing the next cursor token. |
| pageSize | number | no | Page size for paginated one-shot fetches. |
| maxPages | number | no | Maximum pages to fetch for one-shot pagination. Default 10. |
upsert_bento_get_public_json
| Name | Type | Required | Description |
|---|---|---|---|
| dashboardId | string | no | Target dashboard/initiative ID. Omit to use the current dashboard. |
| url | string | yes | Public JSON or GeoJSON endpoint URL. |
| method | string | no | HTTP method. Default: GET. GET POST |
| authPreset | string | no | Shared platform auth preset for public APIs. Use 'none' for unauthenticated endpoints. none api_data_gov noaa_token census_api_key bls_api_key socrata_app_token |
| query | object | no | Optional query params as {key: value} for the request. |
Nested schema for queryNo inputs. | |||
| headers | object | no | Optional non-secret request headers as {key: value} for public APIs. |
Nested schema for headersNo inputs. | |||
| body | object | no | Optional JSON body for POST requests. |
Nested schema for bodyNo inputs. | |||
| recordPath | string | no | Dot path to the array of result records inside the JSON response, e.g. 'results' or 'response.data'. |
| filter_paths | string[] | no | Optional glob paths to reduce the response returned to the model. |
| paginationType | string | no | Pagination strategy for the one-shot fetch. none offset cursor link_header |
| paginationLimitParam | string | no | Limit param name for offset pagination. |
| paginationOffsetParam | string | no | Offset param name for offset pagination. |
| paginationCursorParam | string | no | Cursor query param name for cursor pagination. |
| paginationNextCursorPath | string | no | Response path containing the next cursor token. |
| pageSize | number | no | Page size for paginated one-shot fetches. |
| maxPages | number | no | Maximum pages to fetch for one-shot pagination. Default 10. |
| polling_frequency | string | yes | How often to poll the endpoint, e.g. '15m', '1h', or 'realtime'. |
| connectorId | string | no | If provided, updates the existing connector instead of creating a new one. |
| description | string | no | Human-readable description of what this connector monitors. |
| idExpression | string | no | Optional Bloblang expression for the Firestore document ID. Provide this when the source has a stable unique field. |
| highWaterMarkQueryParam | string | no | Optional query param name used for incremental polling, e.g. 'updated_after'. |
| highWaterMarkInitialValue | string | no | Optional Bloblang expression for the initial high-water-mark value. |
| highWaterMarkNextValue | string | no | Optional Bloblang expression for the next high-water-mark value. |