ckanapi_harvesters package
Subpackages
- ckanapi_harvesters.auxiliary package
- Submodules
- ckanapi_harvesters.auxiliary.ckan_action module
- ckanapi_harvesters.auxiliary.ckan_api_key module
- ckanapi_harvesters.auxiliary.ckan_auxiliary module
CkanFieldInternalAttrsCkanIdFieldTreatmentDataStoreReprFormatFileChunkDataFrameLinesRequestCounterRequestType_reassign_limit_argument()assert_or_raise()bytes_to_megabytes()ca_arg_to_str()ca_file_rel_to_dir()dict_recursive_update()empty_str_to_None()find_duplicates()import_args_kwargs_dict()json_encode_params()parse_geometry_native_type()requests_multipart_data()round_size()size_str_mb()sql_varname_escape()ssl_arguments_decompose()str_is_not_empty()str_to_python_value()to_jsons_indent_lists_single_line()upload_prepare_requests_files_arg()
- ckanapi_harvesters.auxiliary.ckan_configuration module
- ckanapi_harvesters.auxiliary.ckan_defs module
- ckanapi_harvesters.auxiliary.ckan_errors module
AdminFeatureLockedErrorApiKeyFileErrorArgumentErrorCkanArgumentErrorCkanMandatoryArgumentErrorCkanServerErrorDataStoreNotFoundErrorDuplicateNameErrorExternalUrlLockedErrorFileFormatRequirementErrorFileOrDirNotExistErrorForbiddenNameErrorFunctionMissingArgumentErrorHostContraintErrorHttpRetryCodeErrorIncompletePatchErrorIntegrityErrorInvalidParameterErrorLocalApiKeyErrorLoginFileErrorMandatoryAttributeErrorMaxAttemptsErrorMaxRequestsCountErrorMissingCodeFileErrorMissingDataStoreInfoErrorMissingIOFunctionErrorMissingIdErrorMultipleErrorsMultipleResultsErrorNameFormatErrorNoCAVerificationErrorNoDefaultViewNoPackageSizeErrorNotMappedObjectNameErrorReadOnlyErrorRequestErrorRequirementErrorSearchAllNoCountsErrorUnexpectedErrorUnknownCliArgumentErrorUnknownTargetCRSErrorUrlError
- ckanapi_harvesters.auxiliary.ckan_field_types module
CkanFieldTypeCkanFieldTypeABCCkanFieldTypeEnumCkanFieldTypeEnum.NumericCkanFieldTypeEnum.TextCkanFieldTypeEnum.TimeStampCkanFieldTypeEnum.bigintCkanFieldTypeEnum.bigserialCkanFieldTypeEnum.bitCkanFieldTypeEnum.boolCkanFieldTypeEnum.boxCkanFieldTypeEnum.bsonCkanFieldTypeEnum.byteaCkanFieldTypeEnum.charCkanFieldTypeEnum.cidrCkanFieldTypeEnum.circleCkanFieldTypeEnum.dateCkanFieldTypeEnum.floatCkanFieldTypeEnum.float4CkanFieldTypeEnum.float8CkanFieldTypeEnum.from_str()CkanFieldTypeEnum.geometryCkanFieldTypeEnum.inetCkanFieldTypeEnum.intCkanFieldTypeEnum.int16CkanFieldTypeEnum.int2CkanFieldTypeEnum.int32CkanFieldTypeEnum.int4CkanFieldTypeEnum.int64CkanFieldTypeEnum.int8CkanFieldTypeEnum.integerCkanFieldTypeEnum.jsonCkanFieldTypeEnum.jsonbCkanFieldTypeEnum.lineCkanFieldTypeEnum.lsegCkanFieldTypeEnum.macaddrCkanFieldTypeEnum.moneyCkanFieldTypeEnum.oidCkanFieldTypeEnum.pathCkanFieldTypeEnum.pointCkanFieldTypeEnum.polygonCkanFieldTypeEnum.serialCkanFieldTypeEnum.serial4CkanFieldTypeEnum.serial8CkanFieldTypeEnum.timeCkanFieldTypeEnum.timestamptzCkanFieldTypeEnum.timetzCkanFieldTypeEnum.uuidCkanFieldTypeEnum.varbitCkanFieldTypeEnum.varcharCkanFieldTypeEnum.xml
- ckanapi_harvesters.auxiliary.ckan_map module
CkanMapCkanMap._update_datastore_info()CkanMap._update_datastore_len()CkanMap._update_group_info()CkanMap._update_license_info()CkanMap._update_organization_info()CkanMap._update_package_info()CkanMap._update_resource_info()CkanMap._update_user_info()CkanMap.copy()CkanMap.from_dict()CkanMap.get_datastore_info()CkanMap.get_datastore_len()CkanMap.get_group_id()CkanMap.get_group_info()CkanMap.get_license_id()CkanMap.get_license_info()CkanMap.get_organization_for_owner_org()CkanMap.get_organization_id()CkanMap.get_organization_info()CkanMap.get_package_id()CkanMap.get_package_info()CkanMap.get_resource_id()CkanMap.get_resource_info()CkanMap.get_resource_package_id()CkanMap.get_user_id()CkanMap.get_user_info()CkanMap.purge()CkanMap.to_dict()CkanMap.update_from_dict()
CkanMapABC
- ckanapi_harvesters.auxiliary.ckan_model module
CkanAliasInfoCkanApiTokenInfoCkanCapacityCkanCollaborationCkanConfigurableObjectABCCkanDataStoreInfoCkanDataStoreInfo.aliasesCkanDataStoreInfo.copy()CkanDataStoreInfo.detailsCkanDataStoreInfo.fields_dictCkanDataStoreInfo.fields_id_listCkanDataStoreInfo.from_dict()CkanDataStoreInfo.get_basic_field_list_dict()CkanDataStoreInfo.get_original_field_list_dict()CkanDataStoreInfo.get_recomp_field_list_dict()CkanDataStoreInfo.index_fieldsCkanDataStoreInfo.index_size_mbCkanDataStoreInfo.indexesCkanDataStoreInfo.primary_keyCkanDataStoreInfo.resource_idCkanDataStoreInfo.row_countCkanDataStoreInfo.table_size_mbCkanDataStoreInfo.to_dict()
CkanFieldCkanField.configurable_attributesCkanField.copy()CkanField.data_typeCkanField.detailsCkanField.from_ckan_dict()CkanField.from_dict()CkanField.get_resource_type()CkanField.internal_attrsCkanField.is_indexCkanField.labelCkanField.mandatory_attributesCkanField.merge()CkanField.nameCkanField.notesCkanField.notnullCkanField.to_ckan_dict()CkanField.to_dict()CkanField.type_overrideCkanField.uniquekeyCkanField.update_missing()
CkanGroupInfoCkanGroupInfo.copy()CkanGroupInfo.descriptionCkanGroupInfo.detailsCkanGroupInfo.from_dict()CkanGroupInfo.get_resource_type()CkanGroupInfo.idCkanGroupInfo.nameCkanGroupInfo.package_countCkanGroupInfo.package_membersCkanGroupInfo.titleCkanGroupInfo.to_dict()CkanGroupInfo.user_capacitiesCkanGroupInfo.user_dict
CkanIdentifiedObjectCkanLicenseDomainCkanLicenseInfoCkanOrganizationInfoCkanPackageInfoCkanPackageInfo.authorCkanPackageInfo.author_emailCkanPackageInfo.collaboratorsCkanPackageInfo.configurable_attributesCkanPackageInfo.copy()CkanPackageInfo.creator_user_idCkanPackageInfo.custom_fieldsCkanPackageInfo.descriptionCkanPackageInfo.detailsCkanPackageInfo.extra_attributesCkanPackageInfo.from_dict()CkanPackageInfo.get_resource_index()CkanPackageInfo.get_resource_type()CkanPackageInfo.groupsCkanPackageInfo.idCkanPackageInfo.license_idCkanPackageInfo.maintainerCkanPackageInfo.maintainer_emailCkanPackageInfo.mandatory_attributesCkanPackageInfo.metadata_createdCkanPackageInfo.metadata_modifiedCkanPackageInfo.nameCkanPackageInfo.newly_createdCkanPackageInfo.organization_infoCkanPackageInfo.package_resourcesCkanPackageInfo.package_sizeCkanPackageInfo.package_typeCkanPackageInfo.privateCkanPackageInfo.requested_datastore_infoCkanPackageInfo.resources_id_indexCkanPackageInfo.resources_id_index_countsCkanPackageInfo.stateCkanPackageInfo.tagsCkanPackageInfo.tags_infoCkanPackageInfo.titleCkanPackageInfo.to_dict()CkanPackageInfo.update()CkanPackageInfo.update_resource()CkanPackageInfo.updatedCkanPackageInfo.urlCkanPackageInfo.user_accessCkanPackageInfo.version
CkanPackageSizeInfoCkanPackageSizeInfo.datastore_countCkanPackageSizeInfo.datastore_linesCkanPackageSizeInfo.datastore_size_mbCkanPackageSizeInfo.date_last_modified_resourceCkanPackageSizeInfo.date_last_modified_resource_metadataCkanPackageSizeInfo.external_resource_countCkanPackageSizeInfo.external_size_mbCkanPackageSizeInfo.filestore_countCkanPackageSizeInfo.filestore_size_mbCkanPackageSizeInfo.reset()CkanPackageSizeInfo.resource_count
CkanResourceInfoCkanResourceInfo.configurable_attributesCkanResourceInfo.copy()CkanResourceInfo.createdCkanResourceInfo.datastore_activeCkanResourceInfo.datastore_infoCkanResourceInfo.datastore_info_errorCkanResourceInfo.datastore_info_queriedCkanResourceInfo.datastore_queried()CkanResourceInfo.descriptionCkanResourceInfo.detailsCkanResourceInfo.download_size_mbCkanResourceInfo.download_urlCkanResourceInfo.extra_attributesCkanResourceInfo.formatCkanResourceInfo.from_dict()CkanResourceInfo.get_resource_type()CkanResourceInfo.idCkanResourceInfo.index_in_packageCkanResourceInfo.is_datastore()CkanResourceInfo.last_modifiedCkanResourceInfo.mandatory_attributesCkanResourceInfo.metadata_modifiedCkanResourceInfo.nameCkanResourceInfo.newly_createdCkanResourceInfo.newly_updatedCkanResourceInfo.package_idCkanResourceInfo.resource_typeCkanResourceInfo.stateCkanResourceInfo.to_dict()CkanResourceInfo.update()CkanResourceInfo.update_missing()CkanResourceInfo.update_view()CkanResourceInfo.view_is_full_listCkanResourceInfo.views
CkanStateCkanStatusCkanTagInfoCkanUserInfoCkanUserInfo.aboutCkanUserInfo.copy()CkanUserInfo.createdCkanUserInfo.detailsCkanUserInfo.display_nameCkanUserInfo.emailCkanUserInfo.email_hashCkanUserInfo.from_dict()CkanUserInfo.fullnameCkanUserInfo.get_resource_type()CkanUserInfo.groupsCkanUserInfo.idCkanUserInfo.last_activeCkanUserInfo.nameCkanUserInfo.organizationsCkanUserInfo.stateCkanUserInfo.sysadminCkanUserInfo.to_dict()
CkanViewInfoCkanVisibilityUpsertChoiceckan_email_hash()
- ckanapi_harvesters.auxiliary.ckan_progress_callbacks module
- ckanapi_harvesters.auxiliary.ckan_progress_callbacks_abc module
CkanCallbackLevelCkanProgressBarTypeCkanProgressCallbackABCCkanProgressCallbackABC.add_context()CkanProgressCallbackABC.copy()CkanProgressCallbackABC.default_progress_bar_typeCkanProgressCallbackABC.end_task()CkanProgressCallbackABC.extra_contextCkanProgressCallbackABC.last_progress_file_indexCkanProgressCallbackABC.last_progress_positionCkanProgressCallbackABC.progress_bar_enablesCkanProgressCallbackABC.progress_bar_typeCkanProgressCallbackABC.progress_barsCkanProgressCallbackABC.progress_callback_funCkanProgressCallbackABC.progress_callback_kwargsCkanProgressCallbackABC.release_resources()CkanProgressCallbackABC.remove_context()CkanProgressCallbackABC.start_task()CkanProgressCallbackABC.start_timeCkanProgressCallbackABC.update_task()CkanProgressCallbackABC.verbosity
CkanProgressCallbackEmptyCkanProgressUnits
- ckanapi_harvesters.auxiliary.ckan_progress_callbacks_prototypes module
- ckanapi_harvesters.auxiliary.ckan_progress_callbacks_simple module
- ckanapi_harvesters.auxiliary.ckan_progress_callbacks_tqdm module
CkanProgressCallbackTqdmCkanProgressCallbackTqdm.copy()CkanProgressCallbackTqdm.default_progress_bar_typeCkanProgressCallbackTqdm.end_task()CkanProgressCallbackTqdm.progress_bar_typeCkanProgressCallbackTqdm.progress_bar_update_min_interval_sCkanProgressCallbackTqdm.progress_bar_update_threshold_pctCkanProgressCallbackTqdm.release_resources()CkanProgressCallbackTqdm.start_task()CkanProgressCallbackTqdm.update_task()
- ckanapi_harvesters.auxiliary.ckan_rules module
- ckanapi_harvesters.auxiliary.ckan_vocabulary_deprecated module
- ckanapi_harvesters.auxiliary.deprecated module
- ckanapi_harvesters.auxiliary.error_level_message module
- ckanapi_harvesters.auxiliary.external_code_import module
- ckanapi_harvesters.auxiliary.lazy_imports module
- ckanapi_harvesters.auxiliary.list_records module
- ckanapi_harvesters.auxiliary.login module
- ckanapi_harvesters.auxiliary.path module
- ckanapi_harvesters.auxiliary.proxy_config module
HttpsProxyDefErrorProxyConfigProxyConfig.__init__()ProxyConfig._setup_cli_proxy_parser()ProxyConfig.copy()ProxyConfig.from_cli_args()ProxyConfig.from_str_or_config()ProxyConfig.get_host_port()ProxyConfig.get_proxy_login()ProxyConfig.is_defined()ProxyConfig.load_proxy_auth_environ()ProxyConfig.load_proxy_auth_from_file()ProxyConfig.proxiesProxyConfig.proxy_authProxyConfig.proxy_stringProxyConfig.replace_default_proxy()ProxyConfig.reset()
get_proxies_from_environ()host_port_sep()
- ckanapi_harvesters.auxiliary.ssh_tunnel module
SshLoginSshTunnelSshTunnel.__init__()SshTunnel.close_tunnel()SshTunnel.copy()SshTunnel.get_tunnel_host()SshTunnel.get_tunnel_port()SshTunnel.get_tunnel_url()SshTunnel.is_connected()SshTunnel.is_defined()SshTunnel.print_help_cli()SshTunnel.remote_hostSshTunnel.remote_portSshTunnel.serverSshTunnel.socks_proxySshTunnel.ssh_hostSshTunnel.ssh_loginSshTunnel.ssh_portSshTunnel.start_tunnel()SshTunnel.verbose
- ckanapi_harvesters.auxiliary.urls module
- ckanapi_harvesters.auxiliary.virtual_df_chunks module
- Module contents
- ckanapi_harvesters.builder package
- Subpackages
- ckanapi_harvesters.builder.deprecated package
- ckanapi_harvesters.builder.example package
- Submodules
- ckanapi_harvesters.builder.example.builder_example module
- ckanapi_harvesters.builder.example.builder_example_aux_fun module
- ckanapi_harvesters.builder.example.builder_example_download module
- ckanapi_harvesters.builder.example.builder_example_generate_data module
- ckanapi_harvesters.builder.example.builder_example_patch_upload module
- ckanapi_harvesters.builder.example.builder_example_policy module
- ckanapi_harvesters.builder.example.builder_example_sample_dataset module
- ckanapi_harvesters.builder.example.builder_example_test_sql module
- ckanapi_harvesters.builder.example.builder_example_tests module
- ckanapi_harvesters.builder.example.builder_example_tests_dev module
- ckanapi_harvesters.builder.example.builder_example_tests_offline module
- Module contents
- ckanapi_harvesters.builder.specific package
- Submodules
- ckanapi_harvesters.builder.builder_aux module
- ckanapi_harvesters.builder.builder_ckan module
- ckanapi_harvesters.builder.builder_errors module
- ckanapi_harvesters.builder.builder_field module
- ckanapi_harvesters.builder.builder_package module
- ckanapi_harvesters.builder.builder_package_1_basic module
BuilderPackageBasicBuilderPackageBasic.ENV_CKAN_BUILDER_DIRBuilderPackageBasic.ENV_CKAN_BUILDER_FILEBuilderPackageBasic.ENV_CKAN_DOWNLOAD_DIRBuilderPackageBasic.ENV_CKAN_PACKAGE_NAMEBuilderPackageBasic.ENV_CKAN_RESOURCES_DIRBuilderPackageBasic._apply_out_dir_src()BuilderPackageBasic._apply_resources_base_dir_src()BuilderPackageBasic._get_builder_df()BuilderPackageBasic._get_datastores_df()BuilderPackageBasic._get_datastores_dict()BuilderPackageBasic._get_mono_resource_names()BuilderPackageBasic._get_mono_resource_used_files()BuilderPackageBasic._get_resources_df()BuilderPackageBasic._load_from_df()BuilderPackageBasic._to_dict()BuilderPackageBasic.clear_ids()BuilderPackageBasic.clear_secrets_and_disconnect()BuilderPackageBasic.copy()BuilderPackageBasic.default_out_dirBuilderPackageBasic.default_sample_title_suffixBuilderPackageBasic.default_sample_url_suffixBuilderPackageBasic.default_to_json_reduced_sizeBuilderPackageBasic.download_request_full()BuilderPackageBasic.download_resource()BuilderPackageBasic.download_resource_df()BuilderPackageBasic.download_sample()BuilderPackageBasic.download_sample_df()BuilderPackageBasic.from_ckan()BuilderPackageBasic.from_dict()BuilderPackageBasic.from_excel()BuilderPackageBasic.from_json()BuilderPackageBasic.from_jsons()BuilderPackageBasic.get_all_df()BuilderPackageBasic.get_base_dir()BuilderPackageBasic.get_default_out_dir()BuilderPackageBasic.get_license_id()BuilderPackageBasic.get_license_info()BuilderPackageBasic.get_license_name()BuilderPackageBasic.get_or_query_package_id()BuilderPackageBasic.get_or_query_resource_id()BuilderPackageBasic.get_owner_org()BuilderPackageBasic.get_package_page_url()BuilderPackageBasic.get_resources_base_dir()BuilderPackageBasic.info_request_full()BuilderPackageBasic.info_request_package()BuilderPackageBasic.init_ckan()BuilderPackageBasic.init_resources_options_and_metadata()BuilderPackageBasic.list_resource_ids()BuilderPackageBasic.local_policy_check()BuilderPackageBasic.map_resources()BuilderPackageBasic.package_delete()BuilderPackageBasic.package_delete_resources()BuilderPackageBasic.package_nameBuilderPackageBasic.package_resource_reorder()BuilderPackageBasic.patch_request_final()BuilderPackageBasic.patch_request_full()BuilderPackageBasic.patch_request_package()BuilderPackageBasic.remote_policy_check()BuilderPackageBasic.resources_base_dirBuilderPackageBasic.set_default_out_dir()BuilderPackageBasic.set_resources_base_dir()BuilderPackageBasic.setup_auto_draft_state()BuilderPackageBasic.setup_sample_package()BuilderPackageBasic.to_ckan_package_info()BuilderPackageBasic.to_dict()BuilderPackageBasic.to_excel()BuilderPackageBasic.to_json()BuilderPackageBasic.to_jsons()BuilderPackageBasic.unlock_external_code_execution()BuilderPackageBasic.unlock_external_url_resource_download()BuilderPackageBasic.unlock_no_ca()BuilderPackageBasic.update_ckan_map()BuilderPackageBasic.update_from_ckan()BuilderPackageBasic.update_package_name_in_resources()BuilderPackageBasic.upload_file_checks()BuilderPackageBasic.upload_large_datasets()
excel_name_of_builder()excel_name_of_sheet()load_aux_pages_df()
- ckanapi_harvesters.builder.builder_package_2_harvesters module
- ckanapi_harvesters.builder.builder_resource module
BuilderFileABCBuilderFileBinaryBuilderResourceABCBuilderResourceABC._merge_resource_attributes()BuilderResourceABC._to_ckan_resource_info()BuilderResourceABC._update_metadata()BuilderResourceABC.clear_secrets_and_disconnect()BuilderResourceABC.copy()BuilderResourceABC.delete_request()BuilderResourceABC.download_request()BuilderResourceABC.download_resource_bytes()BuilderResourceABC.download_sample_df()BuilderResourceABC.get_or_query_package_id()BuilderResourceABC.get_or_query_resource_id()BuilderResourceABC.get_sample_file_path()BuilderResourceABC.init_options_from_ckan()BuilderResourceABC.initialize_from_options_string()BuilderResourceABC.load_sample_data()BuilderResourceABC.package_nameBuilderResourceABC.patch_request()BuilderResourceABC.resource_info_request()BuilderResourceABC.resource_mode_str()BuilderResourceABC.sample_file_path_is_url()BuilderResourceABC.upload_file_checks()BuilderResourceABC.upload_request()BuilderResourceABC.upload_request_final()
BuilderResourceUnmanagedBuilderResourceUnmanaged.copy()BuilderResourceUnmanaged.get_sample_file_path()BuilderResourceUnmanaged.load_sample_data()BuilderResourceUnmanaged.patch_request()BuilderResourceUnmanaged.resource_mode_str()BuilderResourceUnmanaged.sample_file_path_is_url()BuilderResourceUnmanaged.upload_file_checks()
BuilderUrlBuilderUrlABC
- ckanapi_harvesters.builder.builder_resource_datastore module
BuilderDataStoreABCBuilderDataStoreABC._check_necessary_fields()BuilderDataStoreABC._get_fields_update()BuilderDataStoreABC._merge_resource_attributes_from_file()BuilderDataStoreABC.apply_one_frame_per_primary_key()BuilderDataStoreABC.copy()BuilderDataStoreABC.download_resource_bytes()BuilderDataStoreABC.download_resource_df()BuilderDataStoreABC.download_sample_df()BuilderDataStoreABC.get_sample_file_path()BuilderDataStoreABC.init_options_from_ckan()BuilderDataStoreABC.initialize_extra_options_string()BuilderDataStoreABC.initialize_from_options_string()BuilderDataStoreABC.load_sample_data()BuilderDataStoreABC.load_sample_df()BuilderDataStoreABC.patch_request()BuilderDataStoreABC.print_help_cli()BuilderDataStoreABC.sample_file_path_is_url()BuilderDataStoreABC.setup_default_file_mapper()BuilderDataStoreABC.upsert_request_df()BuilderDataStoreABC.upsert_request_final()
BuilderResourceIgnoredBuilderResourceIgnored.copy()BuilderResourceIgnored.download_request()BuilderResourceIgnored.download_resource_bytes()BuilderResourceIgnored.get_sample_file_path()BuilderResourceIgnored.load_sample_data()BuilderResourceIgnored.load_sample_df()BuilderResourceIgnored.patch_request()BuilderResourceIgnored.resource_mode_str()BuilderResourceIgnored.sample_file_path_is_url()BuilderResourceIgnored.upload_file_checks()
- ckanapi_harvesters.builder.builder_resource_datastore_file module
BuilderDataStoreFileBuilderDataStoreFile.copy()BuilderDataStoreFile.download_request()BuilderDataStoreFile.download_request_full()BuilderDataStoreFile.get_local_file_count()BuilderDataStoreFile.get_local_file_offset()BuilderDataStoreFile.get_local_file_size_units()BuilderDataStoreFile.get_local_file_total_size()BuilderDataStoreFile.get_sample_file_path()BuilderDataStoreFile.list_local_files()BuilderDataStoreFile.resource_mode_str()BuilderDataStoreFile.sample_file_path_is_url()BuilderDataStoreFile.to_builder_datastore_folder()BuilderDataStoreFile.upload_file_checks()
- ckanapi_harvesters.builder.builder_resource_datastore_multi_abc module
BuilderDataStoreMultiABCBuilderDataStoreMultiABC._update_metadata()BuilderDataStoreMultiABC.copy()BuilderDataStoreMultiABC.download_file_query_generator()BuilderDataStoreMultiABC.download_request_full()BuilderDataStoreMultiABC.download_request_generator()BuilderDataStoreMultiABC.download_resource_bytes()BuilderDataStoreMultiABC.download_resource_df()BuilderDataStoreMultiABC.get_datastore_len()BuilderDataStoreMultiABC.setup_default_file_mapper()BuilderDataStoreMultiABC.upload_request_final()BuilderDataStoreMultiABC.upload_request_full()BuilderDataStoreMultiABC.upsert_request_df_no_return()BuilderDataStoreMultiABC.upsert_request_final()
- ckanapi_harvesters.builder.builder_resource_datastore_multi_ckan module
- ckanapi_harvesters.builder.builder_resource_datastore_multi_folder module
BuilderDataStoreFolderBuilderDataStoreFolder.copy()BuilderDataStoreFolder.download_file_query()BuilderDataStoreFolder.download_file_query_item()BuilderDataStoreFolder.download_file_query_list()BuilderDataStoreFolder.download_request()BuilderDataStoreFolder.get_file_query_count()BuilderDataStoreFolder.get_file_query_generator()BuilderDataStoreFolder.get_local_df_chunk_generator()BuilderDataStoreFolder.get_local_file_count()BuilderDataStoreFolder.get_local_file_offset()BuilderDataStoreFolder.get_local_file_size_units()BuilderDataStoreFolder.get_local_file_total_size()BuilderDataStoreFolder.get_sample_file_path()BuilderDataStoreFolder.init_download_file_query_list()BuilderDataStoreFolder.init_local_files_list()BuilderDataStoreFolder.list_local_files()BuilderDataStoreFolder.load_sample_df()BuilderDataStoreFolder.resource_mode_str()BuilderDataStoreFolder.setup_download_file_query_list()BuilderDataStoreFolder.upload_file_checks()BuilderDataStoreFolder.upsert_request_df()
- ckanapi_harvesters.builder.builder_resource_datastore_multi_harvester module
BuilderDataStoreHarvesterBuilderDataStoreHarvester.clear_secrets_and_disconnect()BuilderDataStoreHarvester.copy()BuilderDataStoreHarvester.from_file_datastore()BuilderDataStoreHarvester.get_local_df_chunk_generator()BuilderDataStoreHarvester.get_local_file_count()BuilderDataStoreHarvester.get_local_file_size_units()BuilderDataStoreHarvester.get_sample_file_path()BuilderDataStoreHarvester.harvesterBuilderDataStoreHarvester.init_local_files_list()BuilderDataStoreHarvester.init_options_from_ckan()BuilderDataStoreHarvester.initialize_extra_options_string()BuilderDataStoreHarvester.list_local_files()BuilderDataStoreHarvester.resource_mode_str()BuilderDataStoreHarvester.upload_file_checks()BuilderDataStoreHarvester.upsert_request_df()
- ckanapi_harvesters.builder.builder_resource_datastore_unmanaged module
BuilderDataStoreUnmanagedBuilderDataStoreUnmanaged.copy()BuilderDataStoreUnmanaged.get_local_df_chunk_generator()BuilderDataStoreUnmanaged.get_sample_file_path()BuilderDataStoreUnmanaged.init_local_files_list()BuilderDataStoreUnmanaged.load_sample_df()BuilderDataStoreUnmanaged.patch_request()BuilderDataStoreUnmanaged.resource_mode_str()BuilderDataStoreUnmanaged.upload_file_checks()
- ckanapi_harvesters.builder.builder_resource_datastore_url module
BuilderDataStoreUrlBuilderDataStoreUrl.copy()BuilderDataStoreUrl.get_local_df_chunk_generator()BuilderDataStoreUrl.get_sample_file_path()BuilderDataStoreUrl.init_local_files_list()BuilderDataStoreUrl.load_sample_data()BuilderDataStoreUrl.patch_request()BuilderDataStoreUrl.resource_mode_str()BuilderDataStoreUrl.sample_file_path_is_url()BuilderDataStoreUrl.upload_file_checks()BuilderDataStoreUrl.upload_request_full()
- ckanapi_harvesters.builder.builder_resource_init module
- ckanapi_harvesters.builder.builder_resource_multi_abc module
BuilderMultiABCBuilderMultiABC._unit_download_apply()BuilderMultiABC._unit_upload_apply()BuilderMultiABC.copy()BuilderMultiABC.download_file_query_item()BuilderMultiABC.download_file_query_item_graceful()BuilderMultiABC.download_request_full()BuilderMultiABC.download_request_full_multi_threaded()BuilderMultiABC.download_request_generator()BuilderMultiABC.get_file_query_count()BuilderMultiABC.get_file_query_generator()BuilderMultiABC.get_local_df_chunk_generator()BuilderMultiABC.get_local_file_count()BuilderMultiABC.get_local_file_offset()BuilderMultiABC.get_local_file_size_units()BuilderMultiABC.get_local_file_total_size()BuilderMultiABC.init_download_file_query_list()BuilderMultiABC.init_local_files_list()BuilderMultiABC.upload_request_final()BuilderMultiABC.upload_request_full()BuilderMultiABC.upload_request_full_multi_threaded()BuilderMultiABC.upload_request_graceful()
- ckanapi_harvesters.builder.builder_resource_multi_datastore module
BuilderMultiDataStoreBuilderMultiDataStore.copy()BuilderMultiDataStore.download_file_query_item()BuilderMultiDataStore.download_file_query_item_df()BuilderMultiDataStore.download_request_generator_df()BuilderMultiDataStore.get_local_df_chunk_generator()BuilderMultiDataStore.init_options_from_ckan()BuilderMultiDataStore.load_sample_df()BuilderMultiDataStore.resource_mode_str()BuilderMultiDataStore.upload_file_chunk()
- ckanapi_harvesters.builder.builder_resource_multi_file module
BuilderMultiFileBuilderMultiFile.copy()BuilderMultiFile.download_file_query_item()BuilderMultiFile.download_request()BuilderMultiFile.download_request_full()BuilderMultiFile.download_request_generator()BuilderMultiFile.download_resource_bytes()BuilderMultiFile.get_file_query_count()BuilderMultiFile.get_file_query_generator()BuilderMultiFile.get_local_df_chunk_generator()BuilderMultiFile.get_local_file_count()BuilderMultiFile.get_local_file_generator()BuilderMultiFile.get_local_file_offset()BuilderMultiFile.get_local_file_size_units()BuilderMultiFile.get_local_file_total_size()BuilderMultiFile.get_or_query_resource_id()BuilderMultiFile.get_sample_file_path()BuilderMultiFile.init_download_file_query_list()BuilderMultiFile.init_local_files_list()BuilderMultiFile.init_options_from_ckan()BuilderMultiFile.list_local_files()BuilderMultiFile.list_remote_resource_ids()BuilderMultiFile.list_remote_resources()BuilderMultiFile.load_sample_data()BuilderMultiFile.patch_request()BuilderMultiFile.resource_info_request()BuilderMultiFile.resource_mode_str()BuilderMultiFile.sample_file_path_is_url()BuilderMultiFile.upload_file_checks()BuilderMultiFile.upload_file_chunk()BuilderMultiFile.upload_request_final()BuilderMultiFile.upload_request_full()
- ckanapi_harvesters.builder.mapper_datastore module
- ckanapi_harvesters.builder.mapper_datastore_multi module
RequestFileMapperABCRequestFileMapperIndexKeysRequestFileMapperIndexKeys.df_upload_alter()RequestFileMapperIndexKeys.download_file_query_list()RequestFileMapperIndexKeys.get_file_name_of_query()RequestFileMapperIndexKeys.get_file_query_of_df()RequestFileMapperIndexKeys.get_necessary_fields()RequestFileMapperIndexKeys.last_inserted_index_request()RequestFileMapperIndexKeys.last_inserted_row_request()RequestFileMapperIndexKeys.last_rows_limit
RequestFileMapperLimitRequestFileMapperUserRequestMapperABCRequestMapperABC.download_file_query()RequestMapperABC.download_file_query_generator()RequestMapperABC.download_file_query_list()RequestMapperABC.get_file_query_of_df()RequestMapperABC.last_inserted_index_request()RequestMapperABC.last_inserted_row_request()RequestMapperABC.upsert_only_missing_rows
default_file_mapper_from_primary_key()
- ckanapi_harvesters.builder.mapper_datastore_prototypes module
- ckanapi_harvesters.builder.specific_builder_abc module
- Module contents
- Subpackages
- ckanapi_harvesters.ckan_api package
- Subpackages
- Submodules
- ckanapi_harvesters.ckan_api.ckan_api module
- ckanapi_harvesters.ckan_api.ckan_api_0_base module
CkanApiABCCkanApiBaseCkanApiBase.CKAN_URL_ENVIRONCkanApiBase.__init__()CkanApiBase.__str__()CkanApiBase._api_action_request()CkanApiBase._ckan_url_request()CkanApiBase._cli_ckan_args_apply()CkanApiBase._get_api_url()CkanApiBase._init_session()CkanApiBase._prepare_headers()CkanApiBase._request_all_results_df()CkanApiBase._request_all_results_list()CkanApiBase._request_all_results_page_generator()CkanApiBase._setup_cli_ckan_parser()CkanApiBase.api_action_call()CkanApiBase.api_help_show()CkanApiBase.apikeyCkanApiBase.connect()CkanApiBase.copy()CkanApiBase.disconnect()CkanApiBase.download_url_proxy()CkanApiBase.download_url_proxy_test_head()CkanApiBase.full_unlock()CkanApiBase.init_from_environ()CkanApiBase.initialize_from_cli_args()CkanApiBase.initialize_from_options_string()CkanApiBase.input_cli_args()CkanApiBase.input_missing_info()CkanApiBase.is_url_internal()CkanApiBase.load_apikey()CkanApiBase.prepare_arguments_for_url_download_request()CkanApiBase.prepare_for_multithreading()CkanApiBase.print_help_cli()CkanApiBase.purge()CkanApiBase.set_limits()CkanApiBase.set_limits_per_request()CkanApiBase.set_proxies()CkanApiBase.set_requests_delay()CkanApiBase.set_requests_timeout()CkanApiBase.set_verbosity()CkanApiBase.test_ckan_url_reachable()CkanApiBase.unlock_external_url_resource_download()CkanApiBase.unlock_no_ca()CkanApiBase.url
- ckanapi_harvesters.ckan_api.ckan_api_1_map module
CkanApiMapCkanApiMap.__init__()CkanApiMap._api_datastore_info()CkanApiMap._api_group_list()CkanApiMap._api_group_list_all()CkanApiMap._api_group_show()CkanApiMap._api_license_list()CkanApiMap._api_organization_list()CkanApiMap._api_organization_list_all()CkanApiMap._api_organization_show()CkanApiMap._api_package_collaborator_list()CkanApiMap._api_package_collaborator_list_for_user()CkanApiMap._api_package_search()CkanApiMap._api_package_search_all()CkanApiMap._api_package_show()CkanApiMap._api_resource_show()CkanApiMap._api_resource_view_list()CkanApiMap._api_status_show()CkanApiMap._api_user_list()CkanApiMap._api_user_show()CkanApiMap._enrich_resource_info()CkanApiMap.check_package_name_arg()CkanApiMap.complete_package_list()CkanApiMap.connect()CkanApiMap.copy()CkanApiMap.current_user_is_sysadmin()CkanApiMap.datastore_info()CkanApiMap.get_datastore_fields_or_request_of_id()CkanApiMap.get_datastore_info_or_request()CkanApiMap.get_datastore_info_or_request_of_id()CkanApiMap.get_group_info_or_request()CkanApiMap.get_organization_info_or_request()CkanApiMap.get_package_info_or_request()CkanApiMap.get_package_name_from_url()CkanApiMap.get_package_page_url()CkanApiMap.get_resource_id_or_request()CkanApiMap.get_resource_ids_of_package_list()CkanApiMap.get_resource_info_or_request()CkanApiMap.get_resource_info_or_request_of_id()CkanApiMap.get_resource_page_url()CkanApiMap.get_resource_view_list_or_request()CkanApiMap.get_user_id_or_request()CkanApiMap.get_user_info_or_request()CkanApiMap.group_list()CkanApiMap.group_list_all()CkanApiMap.group_show()CkanApiMap.input_missing_info()CkanApiMap.license_list()CkanApiMap.list_packages_for_user()CkanApiMap.map_resources()CkanApiMap.map_user_rights()CkanApiMap.organization_list_all()CkanApiMap.organization_show()CkanApiMap.package_collaborator_list()CkanApiMap.package_collaborator_list_for_user()CkanApiMap.package_follow_recursive_sources()CkanApiMap.package_search_all()CkanApiMap.package_show()CkanApiMap.purge()CkanApiMap.query_current_user()CkanApiMap.remap_resources()CkanApiMap.resource_is_datastore()CkanApiMap.resource_show()CkanApiMap.resource_view_list()CkanApiMap.set_default_map_mode()CkanApiMap.set_owner_org()CkanApiMap.status_show()CkanApiMap.test_ckan_connection()CkanApiMap.test_ckan_login()CkanApiMap.urlCkanApiMap.user_list()CkanApiMap.user_search()CkanApiMap.user_show()
- ckanapi_harvesters.ckan_api.ckan_api_2_readonly module
CkanApiReadOnlyCkanApiReadOnly.__init__()CkanApiReadOnly._api_datastore_dump_all()CkanApiReadOnly._api_datastore_dump_all_page_generator()CkanApiReadOnly._api_datastore_dump_df()CkanApiReadOnly._api_datastore_dump_raw()CkanApiReadOnly._api_datastore_search_all()CkanApiReadOnly._api_datastore_search_all_page_generator()CkanApiReadOnly._api_datastore_search_df()CkanApiReadOnly._api_datastore_search_raw()CkanApiReadOnly._api_datastore_search_sql_all()CkanApiReadOnly._api_datastore_search_sql_all_page_generator()CkanApiReadOnly._api_datastore_search_sql_df()CkanApiReadOnly._api_datastore_search_sql_raw()CkanApiReadOnly._get_default_bom_option_read()CkanApiReadOnly._get_default_format_read()CkanApiReadOnly._rx_records_df_clean()CkanApiReadOnly.datastore_search()CkanApiReadOnly.datastore_search_cursor()CkanApiReadOnly.datastore_search_fields_type_dict()CkanApiReadOnly.datastore_search_find_one()CkanApiReadOnly.datastore_search_page_generator()CkanApiReadOnly.datastore_search_row_count()CkanApiReadOnly.datastore_search_sql()CkanApiReadOnly.datastore_search_sql_cursor()CkanApiReadOnly.datastore_search_sql_fields_type_dict()CkanApiReadOnly.datastore_search_sql_find_one()CkanApiReadOnly.datastore_search_sql_page_generator()CkanApiReadOnly.from_dict_df_args()CkanApiReadOnly.get_datastore_search_url()CkanApiReadOnly.get_resource_download_url()CkanApiReadOnly.list_datastore_aliases()CkanApiReadOnly.map_file_resource_sizes()CkanApiReadOnly.map_resources()CkanApiReadOnly.read_fields_df_args()CkanApiReadOnly.read_fields_type_dict()CkanApiReadOnly.resource_download()CkanApiReadOnly.resource_download_df()CkanApiReadOnly.resource_download_test_head()CkanApiReadOnly.test_sql_capabilities()
CkanApiReadOnlyParams
- ckanapi_harvesters.ckan_api.ckan_api_3_policy module
- ckanapi_harvesters.ckan_api.ckan_api_4_readwrite module
CkanApiReadWriteCkanApiReadWrite.__init__()CkanApiReadWrite._api_datapusher_submit()CkanApiReadWrite._api_datastore_upsert_raw()CkanApiReadWrite._api_resource_patch()CkanApiReadWrite._datastore_upsert_df()CkanApiReadWrite._datastore_upsert_generator()CkanApiReadWrite.copy()CkanApiReadWrite.datastore_submit()CkanApiReadWrite.datastore_upsert()CkanApiReadWrite.datastore_upsert_last_line()CkanApiReadWrite.datastore_wait()CkanApiReadWrite.full_unlock()CkanApiReadWrite.resource_patch()CkanApiReadWrite.set_limits()CkanApiReadWrite.set_limits_per_request()CkanApiReadWrite.set_submit_timeout()
CkanApiReadWriteParams
- ckanapi_harvesters.ckan_api.ckan_api_5_manage module
CkanApiExtendedParamsCkanApiManageCkanApiManage.__init__()CkanApiManage._api_dataset_purge()CkanApiManage._api_datastore_create()CkanApiManage._api_datastore_delete()CkanApiManage._api_datastore_records_delete()CkanApiManage._api_package_create()CkanApiManage._api_package_delete()CkanApiManage._api_package_patch()CkanApiManage._api_package_resource_reorder()CkanApiManage._api_resource_create()CkanApiManage._api_resource_delete()CkanApiManage._api_resource_view_create()CkanApiManage._datastore_fields_dict_merge()CkanApiManage._datastore_fields_patch_dict()CkanApiManage.copy()CkanApiManage.datastore_clear()CkanApiManage.datastore_create()CkanApiManage.datastore_default_alias()CkanApiManage.datastore_default_alias_of_info()CkanApiManage.datastore_default_alias_of_names()CkanApiManage.datastore_fields()CkanApiManage.datastore_fields_delete()CkanApiManage.datastore_fields_patch()CkanApiManage.datastore_records_delete()CkanApiManage.default_resource_view()CkanApiManage.full_unlock()CkanApiManage.package_create()CkanApiManage.package_delete()CkanApiManage.package_delete_resources()CkanApiManage.package_patch()CkanApiManage.package_resource_reorder()CkanApiManage.package_state_change()CkanApiManage.resource_create()CkanApiManage.resource_delete()CkanApiManage.resource_view_create()CkanApiManage.verify_field_name_format()CkanApiManage.verify_package_name_format()
CkanApiManageParamsclean_table_name()
- ckanapi_harvesters.ckan_api.ckan_api_6_user_access module
CkanApiUserAccessCkanApiUserAccess._api_group_member_create()CkanApiUserAccess._api_group_member_delete()CkanApiUserAccess._api_organization_member_create()CkanApiUserAccess._api_organization_member_delete()CkanApiUserAccess._api_package_collaborator_create()CkanApiUserAccess._api_package_collaborator_delete()CkanApiUserAccess.copy()CkanApiUserAccess.group_member_create()CkanApiUserAccess.group_member_delete()CkanApiUserAccess.organization_member_create()CkanApiUserAccess.organization_member_delete()CkanApiUserAccess.package_collaborator_create()CkanApiUserAccess.package_collaborator_delete()CkanApiUserAccess.package_group_add()CkanApiUserAccess.package_group_remove()
- ckanapi_harvesters.ckan_api.ckan_api_7_sysadmin module
- ckanapi_harvesters.ckan_api.ckan_api_params module
CkanApiDebugCkanApiParamsBasicCkanApiParamsBasic.__init__()CkanApiParamsBasic._cli_ckan_args_apply()CkanApiParamsBasic._setup_cli_ckan_parser__params()CkanApiParamsBasic.action_requests_retry_alwaysCkanApiParamsBasic.ckan_caCkanApiParamsBasic.ckan_headersCkanApiParamsBasic.copy()CkanApiParamsBasic.default_limit_list_per_requestCkanApiParamsBasic.default_limit_read_per_requestCkanApiParamsBasic.dry_runCkanApiParamsBasic.extern_caCkanApiParamsBasic.http_headersCkanApiParamsBasic.max_requests_attemptsCkanApiParamsBasic.max_requests_countCkanApiParamsBasic.multi_requests_limit_reached_warningCkanApiParamsBasic.multi_requests_time_between_requestsCkanApiParamsBasic.multi_requests_timeoutCkanApiParamsBasic.proxiesCkanApiParamsBasic.proxy_authCkanApiParamsBasic.proxy_stringCkanApiParamsBasic.requests_timeoutCkanApiParamsBasic.response_time_wait_thresholdCkanApiParamsBasic.store_last_responseCkanApiParamsBasic.store_last_response_debug_infoCkanApiParamsBasic.time_between_attemptsCkanApiParamsBasic.user_agentCkanApiParamsBasic.verbose_extraCkanApiParamsBasic.verbose_multi_requestsCkanApiParamsBasic.verbose_requestCkanApiParamsBasic.verbose_request_error
- Module contents
- ckanapi_harvesters.harvesters package
- Subpackages
- ckanapi_harvesters.harvesters.data_cleaner package
- Submodules
- ckanapi_harvesters.harvesters.data_cleaner.data_cleaner_abc module
- ckanapi_harvesters.harvesters.data_cleaner.data_cleaner_errors module
- ckanapi_harvesters.harvesters.data_cleaner.data_cleaner_init module
- ckanapi_harvesters.harvesters.data_cleaner.data_cleaner_upload module
- ckanapi_harvesters.harvesters.data_cleaner.data_cleaner_upload_1_basic module
- ckanapi_harvesters.harvesters.data_cleaner.data_cleaner_upload_2_geom module
- ckanapi_harvesters.harvesters.data_cleaner.data_cleaner_upload_3_assist module
- ckanapi_harvesters.harvesters.data_cleaner.data_cleaner_upload_3_check module
- Module contents
- ckanapi_harvesters.harvesters.file_formats package
- Submodules
- ckanapi_harvesters.harvesters.file_formats.auxiliary_defs module
- ckanapi_harvesters.harvesters.file_formats.csv_format module
- ckanapi_harvesters.harvesters.file_formats.file_format_abc module
- ckanapi_harvesters.harvesters.file_formats.file_format_init module
- ckanapi_harvesters.harvesters.file_formats.geoparquet_format module
- ckanapi_harvesters.harvesters.file_formats.json_format module
- ckanapi_harvesters.harvesters.file_formats.parquet_format module
- ckanapi_harvesters.harvesters.file_formats.shp_format module
- ckanapi_harvesters.harvesters.file_formats.user_format module
- ckanapi_harvesters.harvesters.file_formats.user_format_prototypes module
- ckanapi_harvesters.harvesters.file_formats.xls_format module
- Module contents
- ckanapi_harvesters.harvesters.data_cleaner package
- Submodules
- ckanapi_harvesters.harvesters.harvester_abc module
DatabaseHarvesterABCDatabaseHarvesterABC.clear_secrets()DatabaseHarvesterABC.copy()DatabaseHarvesterABC.get_dataset_harvester()DatabaseHarvesterABC.get_description()DatabaseHarvesterABC.get_login_url_without_auth()DatabaseHarvesterABC.init_from_options_string()DatabaseHarvesterABC.list_datasets()DatabaseHarvesterABC.update_from_ckan()
DatasetHarvesterABCHarvesterConnectABCTableHarvesterABCTableHarvesterABC.clean_table_metadata()TableHarvesterABC.copy()TableHarvesterABC.get_default_data_cleaner()TableHarvesterABC.get_default_df_upload_fun()TableHarvesterABC.get_default_primary_key()TableHarvesterABC.init_from_options_string()TableHarvesterABC.list_queries()TableHarvesterABC.query_data()TableHarvesterABC.query_table_metadata()
- ckanapi_harvesters.harvesters.harvester_errors module
- ckanapi_harvesters.harvesters.harvester_init module
- ckanapi_harvesters.harvesters.harvester_model module
- ckanapi_harvesters.harvesters.harvester_params module
DatabaseParamsDatabaseParams.copy()DatabaseParams.initialize_from_cli_args()DatabaseParams.parse_harvest_method()DatabaseParams.parse_options_string()DatabaseParams.print_help_cli()DatabaseParams.proxiesDatabaseParams.proxy_authDatabaseParams.proxy_stringDatabaseParams.set_verify_ca()DatabaseParams.set_verify_server_ca()DatabaseParams.setup_cli_harvester_parser()DatabaseParams.unlock_external_url_resource_download()DatabaseParams.unlock_no_server_ca()DatabaseParams.verify_server_ca
DatasetParamsTableParams
- ckanapi_harvesters.harvesters.mongodb_data_cleaner module
- ckanapi_harvesters.harvesters.mongodb_harvester module
DatabaseHarvesterMongoServerDatabaseHarvesterMongoServer.check_connection()DatabaseHarvesterMongoServer.connect()DatabaseHarvesterMongoServer.copy()DatabaseHarvesterMongoServer.disconnect()DatabaseHarvesterMongoServer.get_dataset_harvester()DatabaseHarvesterMongoServer.get_description()DatabaseHarvesterMongoServer.get_login_url_without_auth()DatabaseHarvesterMongoServer.init_from_options_string()DatabaseHarvesterMongoServer.is_connected()DatabaseHarvesterMongoServer.list_datasets()
DatasetHarvesterMongoDatabaseDatasetHarvesterMongoDatabase.check_connection()DatasetHarvesterMongoDatabase.clean_dataset_metadata()DatasetHarvesterMongoDatabase.connect()DatasetHarvesterMongoDatabase.disconnect()DatasetHarvesterMongoDatabase.get_description()DatasetHarvesterMongoDatabase.get_table_harvester()DatasetHarvesterMongoDatabase.init_from_options_string()DatasetHarvesterMongoDatabase.is_connected()DatasetHarvesterMongoDatabase.list_tables()DatasetHarvesterMongoDatabase.query_dataset_metadata()
TableHarvesterMongoCollectionTableHarvesterMongoCollection.check_connection()TableHarvesterMongoCollection.clean_table_metadata()TableHarvesterMongoCollection.connect()TableHarvesterMongoCollection.copy()TableHarvesterMongoCollection.disconnect()TableHarvesterMongoCollection.get_default_data_cleaner()TableHarvesterMongoCollection.get_default_primary_key()TableHarvesterMongoCollection.get_description()TableHarvesterMongoCollection.init_from_options_string()TableHarvesterMongoCollection.list_queries()TableHarvesterMongoCollection.query_data()TableHarvesterMongoCollection.query_table_metadata()
- ckanapi_harvesters.harvesters.mongodb_params module
- ckanapi_harvesters.harvesters.postgre_harvester module
DatabaseHarvesterPostgreDatabaseHarvesterPostgre.check_connection()DatabaseHarvesterPostgre.connect()DatabaseHarvesterPostgre.copy()DatabaseHarvesterPostgre.disconnect()DatabaseHarvesterPostgre.get_dataset_harvester()DatabaseHarvesterPostgre.get_description()DatabaseHarvesterPostgre.get_login_url_without_auth()DatabaseHarvesterPostgre.init_from_options_string()DatabaseHarvesterPostgre.is_connected()DatabaseHarvesterPostgre.list_datasets()
DatasetHarvesterPostgreDatasetHarvesterPostgre.check_connection()DatasetHarvesterPostgre.clean_dataset_metadata()DatasetHarvesterPostgre.connect()DatasetHarvesterPostgre.disconnect()DatasetHarvesterPostgre.get_description()DatasetHarvesterPostgre.get_table_harvester()DatasetHarvesterPostgre.init_from_options_string()DatasetHarvesterPostgre.is_connected()DatasetHarvesterPostgre.list_tables()DatasetHarvesterPostgre.query_dataset_metadata()
TableHarvesterPostgreTableHarvesterPostgre._data_type_map_to_ckan()TableHarvesterPostgre._get_field_query_function()TableHarvesterPostgre.check_connection()TableHarvesterPostgre.clean_table_metadata()TableHarvesterPostgre.connect()TableHarvesterPostgre.copy()TableHarvesterPostgre.get_default_data_cleaner()TableHarvesterPostgre.get_default_primary_key()TableHarvesterPostgre.get_description()TableHarvesterPostgre.init_from_options_string()TableHarvesterPostgre.list_queries()TableHarvesterPostgre.query_data()TableHarvesterPostgre.query_table_metadata()TableHarvesterPostgre.update_from_ckan()
- ckanapi_harvesters.harvesters.postgre_params module
- ckanapi_harvesters.harvesters.pymongo_harvester module
- Module contents
- Subpackages
- ckanapi_harvesters.policies package
- Submodules
- ckanapi_harvesters.policies.data_format_policy module
CkanPackageDataFormatPolicyCkanPackageDataFormatPolicy._package_update_policy_scores()CkanPackageDataFormatPolicy.copy()CkanPackageDataFormatPolicy.default_to_json_reduced_sizeCkanPackageDataFormatPolicy.enforce()CkanPackageDataFormatPolicy.from_dict()CkanPackageDataFormatPolicy.from_json()CkanPackageDataFormatPolicy.from_jsons()CkanPackageDataFormatPolicy.package_update_scores()CkanPackageDataFormatPolicy.policy_check_package()CkanPackageDataFormatPolicy.to_dict()CkanPackageDataFormatPolicy.to_json()CkanPackageDataFormatPolicy.to_jsons()
- ckanapi_harvesters.policies.data_format_policy_abc module
- ckanapi_harvesters.policies.data_format_policy_custom_fields module
- ckanapi_harvesters.policies.data_format_policy_defs module
- ckanapi_harvesters.policies.data_format_policy_errors module
- ckanapi_harvesters.policies.data_format_policy_lists module
- ckanapi_harvesters.policies.data_format_policy_output_config module
DataFormatPolicyOutputCustomFieldsDataFormatPolicyOutputCustomFields.copy()DataFormatPolicyOutputCustomFields.default_package_datastore_rowcount_custom_fieldDataFormatPolicyOutputCustomFields.default_package_datastore_size_custom_fieldDataFormatPolicyOutputCustomFields.default_package_external_size_custom_fieldDataFormatPolicyOutputCustomFields.default_package_filestore_size_custom_fieldDataFormatPolicyOutputCustomFields.default_report_custom_fieldDataFormatPolicyOutputCustomFields.default_report_timestamp_fieldDataFormatPolicyOutputCustomFields.default_score_custom_fieldDataFormatPolicyOutputCustomFields.disable_all()DataFormatPolicyOutputCustomFields.set_metadata_policy_fields()DataFormatPolicyOutputCustomFields.to_dict()
- ckanapi_harvesters.policies.data_format_policy_tag_groups module
- ckanapi_harvesters.policies.policy_report module
- Module contents
- ckanapi_harvesters.reports package
Submodules
ckanapi_harvesters.errors module
Alias module to all error codes
Module contents
ckanapi_harvesters Package with helper function for CKAN requests using pandas DataFrames.