range(start[, end, step, num_partitions])
range
Create a DataFrame with some range of numbers.
read_table(name[, index_col])
read_table
Read a Spark table and return a DataFrame.
DataFrame.to_table(name[, format, mode, …])
DataFrame.to_table
Write the DataFrame into a Spark table.
read_delta(path[, version, timestamp, index_col])
read_delta
Read a Delta Lake table on some file system and return a DataFrame.
DataFrame.to_delta(path[, mode, …])
DataFrame.to_delta
Write the DataFrame out as a Delta Lake table.
read_parquet(path[, columns, index_col, …])
read_parquet
Load a parquet object from the file path, returning a DataFrame.
DataFrame.to_parquet(path[, mode, …])
DataFrame.to_parquet
Write the DataFrame out as a Parquet file or directory.
read_orc(path[, columns, index_col])
read_orc
Load an ORC object from the file path, returning a DataFrame.
DataFrame.to_orc(path[, mode, …])
DataFrame.to_orc
Write the DataFrame out as a ORC file or directory.
read_spark_io([path, format, schema, index_col])
read_spark_io
Load a DataFrame from a Spark data source.
DataFrame.to_spark_io([path, format, mode, …])
DataFrame.to_spark_io
Write the DataFrame out to a Spark data source.
read_csv(path[, sep, header, names, …])
read_csv
Read CSV (comma-separated) file into DataFrame or Series.
DataFrame.to_csv([path, sep, na_rep, …])
DataFrame.to_csv
Write object to a comma-separated values (csv) file.
read_clipboard([sep])
read_clipboard
Read text from clipboard and pass to read_csv.
DataFrame.to_clipboard([excel, sep])
DataFrame.to_clipboard
Copy object to the system clipboard.
read_excel(io[, sheet_name, header, names, …])
read_excel
Read an Excel file into a pandas-on-Spark DataFrame or Series.
DataFrame.to_excel(excel_writer[, …])
DataFrame.to_excel
Write object to an Excel sheet.
read_json(path[, lines, index_col])
read_json
Convert a JSON string to DataFrame.
DataFrame.to_json([path, compression, …])
DataFrame.to_json
Convert the object to a JSON string.
read_html(io[, match, flavor, header, …])
read_html
Read HTML tables into a list of DataFrame objects.
list
DataFrame
DataFrame.to_html([buf, columns, col_space, …])
DataFrame.to_html
Render a DataFrame as an HTML table.
read_sql_table(table_name, con[, schema, …])
read_sql_table
Read SQL database table into a DataFrame.
read_sql_query(sql, con[, index_col])
read_sql_query
Read SQL query into a DataFrame.
read_sql(sql, con[, index_col, columns])
read_sql
Read SQL query or database table into a DataFrame.