 |
Qore CsvUtil Module Reference
1.6.2
|
|
Qore CsvUtil Module Reference
1.6.2
|
The AbstractCsvWriter class provides a parent for all CSV writers. More...
Public Member Methods | |
| constructor (string n_errname, *hash n_opts) | |
| Creates the AbstractCsvWriter in single-type mode. More... | |
| constructor (string n_errname, hash spec, hash n_opts) | |
| Creates the AbstractCsvWriter in single-type mode. More... | |
| write (Qore::AbstractIterator iterator) | |
| Stream an iterator into the output. More... | |
| write (Qore::SQL::SQLStatement iterator) | |
| Stream an iterator into the output. More... | |
| write (list l) | |
| Stream the contents of the list into the output. More... | |
| writeLine (list values) | |
| Write a line with a list of values; data are checked against column rules. More... | |
| writeLine (hash values) | |
| Write a line with headers-values hash. More... | |
| writeLine (string type, list values) | |
| Write a line with headers-values list. More... | |
| writeLine (string type, hash values) | |
| Write a line for a specific record from a hash to the output. More... | |
Private Member Methods | |
| string | prepareRawLine (list values) |
| Prepare a string (line with EOF) with formatting and escaping. More... | |
| processCommonOptions (*hash n_opts, int C_OPTx) | |
| Process options and set internal variables. | |
| processSpec () | |
| Process specification and set internal variable for mapping. | |
| writeHeaders () | |
| Write csv headers. | |
| abstract | writeRawLine (list values) |
| This method must be overridden in child classes to provide the output implementation. | |
Private Attributes | |
| string | baseTemplate |
| base template for value format | |
| int | block = 1000 |
| block size for bulk DML | |
| bool | checkElementCounts = False |
verify the column count for every row; if a row does not match, then throw a CSVFILEITERATOR-DATA-ERROR exception | |
| string | encoding |
| output file character encoding | |
| string | eol = EOL_UNIX |
| end of line sequence | |
| *code | info_log |
| a closure/call reference for informational logging when using write(SQLStatement) | |
| int | lineNo = 0 |
| the latest line number | |
| hash | m_out_by_idx |
| mapping output field by index | |
| hash | m_out_by_name |
| mapping output field by name | |
| string | m_quoteEscapeChar = "\\" |
| quote escape character | |
| bool | optimal_quotes = True |
| stores the optimal quotes option | |
| const | Options |
| valid options for the object (a hash for quick lookups of valid keys) | |
| string | quote = "\"" |
| field content delimiter | |
| string | separator = "," |
| field separator | |
| bool | write_headers = True |
| this flag determines if any stored headers are output | |
The AbstractCsvWriter class provides a parent for all CSV writers.
Any inherited class must provide concrete implementations for the following abstract method, where the real physical write action must be implemented.
The AbstractCsvWriter class constructor takes an optional hash with possible keys given in the following table. Note that key names are case-sensitive, and data types are soft (conversions are made when possible).
AbstractCsvWriter Options
| Option | Data Type | Description |
"block" | int | the block size when generating output based on a SQLStatement source (default: 1000) |
"date_format" | string | the default mask for date values formatting |
"encoding" | string | the character encoding for the file (and for tagging string data read); if the value of this key is not a string then it will be ignored |
"eol" | string | the end of line character(s) (default: auto-detect); if the value of this key is not a string then it will be ignored |
"info_log" | code | a call reference / closure for informational logging when performing bulk generation with write(Qore::SQL::SQLStatement); must take a single string argument |
"optimal_quotes" | bool | set to False to disable optimal quoting; when optimal quoting is disabled, all fields are quoted regardless of type or content, when it is enabled, then fields are quoted only if they require quoting (i.e. they contain a quote or separator character); the default is True |
"quote" | string | the field quote character (default: '"') |
"quote_escape" | string | the escape character(s) used for "quote" (default: '\') |
"separator" | string | the string separating the fields in the file (default: ",") |
"verify_columns" | bool | if True (the default is False) then if a line is parsed with a different column count than other lines, a CSVFILEWRITER-DATA-ERROR exception is thrown |
"write_headers" | bool | set to False to suppress the output of headers; the default is True, meaning to output headers if they are present. The value is False for multi-type lines. |
AbstractCsvIterator Single-type-only Options
| Option | Data Type | Description |
"datamap" | hash | a hash mapping actual data key names to the output field names, for use in case the data field names differ; does not have to include every data or output key; keys not present will be assumed to be mapped 1:1 |
"fields" | hash | describes the data to be output; see option field hash and option field types for more information on the possible values of this option; if no field type is given, the default is "*string" |
"headers" | list of strings | list of header / column names for the data iterated. |
"header_reorder" | bool | if True (default value) then if "headers" are provided by options then fields are reordered to follow headers. It has effect on expected field order as passed to write function via list. If False then fields not yet specified are pushed at the end of field definition. |
"date-format" "optimal-quotes" "verify-columns" "write-headers" Creates the AbstractCsvWriter in single-type mode.
| n_errname | a string to construct child class error message. For example: value 'FOO' will result in exception names 'CSVFOOWRITER-ERROR' |
| n_opts | AbstractCsvWriter Constructor Option Hash Overview |
| CSV<errname>ITER-ERROR | in the case of incorrect options |
Creates the AbstractCsvWriter in single-type mode.
| spec | a hash of field and type definition; see Option Field Hash for more information |
| n_errname | a string to construct child class error message. For example: value 'FOO' will result in exception names 'CSVFOOWRITER-ERROR' |
| n_opts | AbstractCsvWriter Constructor Option Hash Overview |
| CSV<errname>WRITER-ERROR | in the case of incorrect options |
Prepare a string (line with EOF) with formatting and escaping.
| values | a list with values |
encoding option was given to the constructor; the return value always has the given encoding | CsvUtil::AbstractCsvWriter::write | ( | Qore::AbstractIterator | iterator | ) |
Stream an iterator into the output.
| iterator | an iterator to stream data into file |
The iterator has to return List or Hash from the getValue() method.
| CSVFILEWRITER-DATA-ERROR | when the data does not fit defined column constraints or when getValue() does not return list or hash |
| CsvUtil::AbstractCsvWriter::write | ( | Qore::SQL::SQLStatement | iterator | ) |
Stream an iterator into the output.
| iterator | an SQLStatement iterator to stream data into file; SQLStatement::fetchColumns() is used to leverage bulk DML for more efficient SQL I/O |
| CSVFILEWRITER-DATA-ERROR | when the data does not fit defined column constraints |
"info_log" option is set in the constructor; it is used here to log each block of SQL data used to generate the corresponding number of lines; log messages look like: "query input generated bulk output lines: 1000" | CsvUtil::AbstractCsvWriter::write | ( | list | l | ) |
Stream the contents of the list into the output.
| l | a list of input data to format as CSV output |
The list has to contain List or Hash elements that can be formatted according to the CSV definition
| CSVFILEWRITER-DATA-ERROR | when the data does not fit defined column constraints or when the list elements have the wrong type or values |
| CsvUtil::AbstractCsvWriter::writeLine | ( | list | values | ) |
Write a line with a list of values; data are checked against column rules.
| values | a list with values. |
| CSVFILEWRITER-DATA-ERROR | when the data does not fit defined column constraints |
| CsvUtil::AbstractCsvWriter::writeLine | ( | hash | values | ) |
Write a line with headers-values hash.
| values | a hash with keys as column headers in single-type format or with hash with "type" and "record" members for multi-type. The format is automatically detected. |
| CSVFILEWRITER-DATA-ERROR | when the data does not fit defined column constraints |
Write a line with headers-values list.
| type | record type |
| values | as list of values |
| CSVFILEWRITER-DATA-ERROR | when the data does not fit defined column constraints |