Catalog.cacheTable(tableName)
Catalog.cacheTable
Caches the specified table in-memory.
Catalog.clearCache()
Catalog.clearCache
Removes all cached tables from the in-memory cache.
Catalog.createExternalTable(tableName[, …])
Catalog.createExternalTable
Creates a table based on the dataset in a data source.
Catalog.createTable(tableName[, path, …])
Catalog.createTable
Catalog.currentDatabase()
Catalog.currentDatabase
Returns the current default database in this session.
Catalog.databaseExists(dbName)
Catalog.databaseExists
Check if the database with the specified name exists.
Catalog.dropGlobalTempView(viewName)
Catalog.dropGlobalTempView
Drops the global temporary view with the given view name in the catalog.
Catalog.dropTempView(viewName)
Catalog.dropTempView
Drops the local temporary view with the given view name in the catalog.
Catalog.functionExists(functionName[, dbName])
Catalog.functionExists
Check if the function with the specified name exists.
Catalog.isCached(tableName)
Catalog.isCached
Returns true if the table is currently cached in-memory.
Catalog.listColumns(tableName[, dbName])
Catalog.listColumns
Returns a list of columns for the given table/view in the specified database.
Catalog.listDatabases()
Catalog.listDatabases
Returns a list of databases available across all sessions.
Catalog.listFunctions([dbName])
Catalog.listFunctions
Returns a list of functions registered in the specified database.
Catalog.listTables([dbName])
Catalog.listTables
Returns a list of tables/views in the specified database.
Catalog.recoverPartitions(tableName)
Catalog.recoverPartitions
Recovers all the partitions of the given table and update the catalog.
Catalog.refreshByPath(path)
Catalog.refreshByPath
Invalidates and refreshes all the cached data (and the associated metadata) for any DataFrame that contains the given data source path.
Catalog.refreshTable(tableName)
Catalog.refreshTable
Invalidates and refreshes all the cached data and metadata of the given table.
Catalog.registerFunction(name, f[, returnType])
Catalog.registerFunction
An alias for spark.udf.register().
spark.udf.register()
Catalog.setCurrentDatabase(dbName)
Catalog.setCurrentDatabase
Sets the current default database in this session.
Catalog.tableExists(tableName[, dbName])
Catalog.tableExists
Check if the table or view with the specified name exists.
Catalog.uncacheTable(tableName)
Catalog.uncacheTable
Removes the specified table from the in-memory cache.