Various resources regarding uspTukubai commands are available here.

 

 

Soul Search

DOCUMENTS

COMMAND

FORUM

UEC DOCS

VIDEO

 

Command List (by Category)

Alphabetical List |  Categorized List |  日本語

General

ugrep Wrapper for GNU grep

Field Operations

charsplit Cuts a field into two fields of fixed length
delf Remove the specified fields
self Outputs the data from the specified fields

Record Operations

cond Evaluates an expression to filter records.
ctail Delete the last n rows of a file
delr Delete lines that match exactly
getfirst Outputs the first record from same key records.
getlast Outputs the last record from same key records.
head2 Replacement for head command
selr Selects rows that match exactly

File Splitting

distribute Writes standard input into separate files one line
distribute2 Divides a file into portions with equality.
keycut Split a file based on a key field (Key must be sorted)
sorter Split a file based on a key

File Concatenation

dmerge Merges files based on a key
filemrg Merge a file into a template
hcat Concatenates files horizontally
interlace Merges records alternating rows
lcat Repeated output of file (looping cat)
ucat "cat" without error when designated file does not exist
up3 Merges two files on the same key field
upl Merges two files on the same key field and then extracts
vcat Concatenates files vertically

Data Transformation

makec Converts row data into columns.
maker Converts columnar data into rows.
map Converts a list to a matrix with row and column headings
transpose Transposes rows and columns
unmap Converts a mapped file back to its original form.
ychange Creates a record showing changes from the previous record

Normalization (Sorting & Initialization)

gtouch Creates a null file in gzip format.
isort In-Memory Sort
itouch Initializes a file
msort In-Memory Sort
psort Partial Sort

Calculation & Aggregation

and Outputs the field values that all files share in common in
calc Insert data or formula immediately after the specified field.
ccnt Counts the columns
count Count the number of rows that contain the same key.
csum Calculate cumulative sum
divk Divide the specified field by 1000
hsum Horizontal sum.
lcalc Perform high precision decimal fixed-point calculation
lcnt Counts lines (rows)
linecut Splits a file into the specified number of lines
lineup Returns the data in the specified field in ascending order
order Returns the order of the record within a block of
plus Adds the arguments
proportion Returns a proportion
rank Add a rank
ratio Returns a ratio
round Round, round-up or truncate
sm2 Sum values by key
sm4 Inserts subtotal lines.
sm5 Output the grand total

Format Conversion

fixlen Turns fields into fixed length.
fromcsv CSV Filter
fromtsv Convert from tab separated format to field format
rexcelx Converts an Excel file to text
time-excel Convert a Date and/or time to Excel date/time format
tocsv Converts a space delimited file to a CSV file
wjson convert data in field format into JSON data.
xmldir Convert from XML file to Field file by specifying XML path
xmlpath Prints paths of XML

Output Formatting

bomnude Removes the byte order mark of UTF-8.
delkey Deletes the key field from consecutive records.
drawline Draw lines
fcols Fix (align) the columns in a text file
linefeed Adds a linefeed to the end of a file.
overlay Overlay one file on top of another.
scrlen Outputs the display width of the specified string
txtmv Moves the position of text.
underlay Overlay fields one record at a time.
wexcelx Merge data into an Excel 2007-2010 report template (xlsx,xlsm)
width Returns the display width of a file

Date & Time

calclock Calculates date and time (calendar clock)
dayslash Transformation of date / time format
mdate Performs date calculations
msec Displays microseconds froc EPOC time.

Character Conversion

cap Converts roman alphabet letters to upper case.
full Convert to full-width (zenkaku) characters.
half Convert to half-width (hankaku) character
kana Converts Japanese "Katakana" to/from "Hiragana"
sml Converts roman alphabet letters to lower case.
uconv UTF-8 <=> Shift JIS / EUC-JP / ISO-8851-1 Code Conversion

String Processing

1x Remove leading zeroes
calsed sed "light"
comma Formats the specified field with commas every 3rd/4th digit.
extname Returns the file extension from a path
fsed Field oriented stream editer
pad0 Add zeros to the beginning
rootname Removes the suffix from a path name
unsco Remove leading and trailing underscores from fields
uriencode performs URI encoding.
utf8nude Removes control characters and invalid UTF-8 characters
xssnude replaces special characters with entity references.

Concatenation & Extraction

cjoin0 Sequential key matching select
cjoin1 Sequential key matching join
cjoin1x Matches files with multiple records sharing the same key value
cjoin2 Sequential key matching join
cjoin2x Matches files with multiple records sharing the same key value
cljoin1 The longest prefix key matching version of cjoin1.
fldcmp Compares files field-by-field
join0 Selects the lines from Master with a matching key field
join1 Joins a master file to a transaction file.
join1x Joins to files where more than one record has
join2 Joins a master file to a transaction file.
join2x Joins to files where more than one record has
joinx Perform a complete join with all possible combinations.
ljoin1 The longest prefix key matching version of join1.
loopj Join all records from multiple files by key.
loopx Join by all possible combinations.

Check

exist Checks if all files exist
iscode Checks the number of digits in a numeric code.
isdate Checks an 8-digit date
ismime Checks if a file is in MIME formant
isnum Checks if the argument is a number

Web Interface

cgi-name Converts data received using the CGI POST method
formfix Fixes (makes read only) all forms in an HTML file
formmrg Merges characters into an HTML template
mime-read Read contents from a multipart MIME formatted file
mnameread Convert multiple name format files to tag format file.
name-tag Converts a file in name format to tag format
nameread Read a file that is in NAME format
strmrg Merge characters into a template
tdconnect merges <td></td> blocks
trconnect merges <tr> elements

Tag Series

tagavg Calculates the average of records with the same key value
tagawk A wrapper for awk that allows tag names to be used
tagcat cat multiple tag files
tagchange Changes the tag name
tagcjoin0 Outputs tag data that exists in the tag master.
tagcjoin1 Joins together tag data that exists in the tag master.
tagcjoin1x Joins together tag data that exists in the tag master.
tagcjoin2 Joins together tag data that exists in the tag master.
tagcjoin2x Joins together tag data that exists in the tag master.
tagclink0 Outputs data that exists in the tag master.
tagclink1 Joins together and outputs tag data that exists in the tag master.
tagclink1x Joins together tag data that exists in the tag master.
tagclink2 Joins together and outputs tag data that exists in the tag master.
tagclink2x Joins together tag data that exists in the tag master.
tagcljoin1 The longest prefix key matching version of tagcjoin1.
tagcomma Formats the specified field with commas every 3rd/4th digit.
tagcount Count the number of rows that contain the same key
tagcpy Copy the specified tag field to a new tag field.
tagdelf Remove the specified field from a tag file and output the result
tagdelr Delete lines that match exactly
tagdivk Divide the specified field by 1000
taggetfirst Outputs the first record with a matching key.
taggetlast Outputs the last record with a matching key.
tagisort In-Memory Sort for tag files
tagjoin0 Outputs tag data whose tags exist in the Tag Master
tagjoin1 Outputs tag data whose tags exist in the Tag Master
tagjoin1x Joins together tag data that exists in the tag master in
tagjoin2 Joins and outputs tag data whose tags exist in
tagjoin2x Joins together tag data that exists in the tag master in
tagjoinx Joins tag data in all possible combinations
tagkeycut Split a file based on a key
taglineup Returns the unique data in the specified field in
taglink0 Outputs tag data that exists in the tag master,
taglink1 Joins together tag data that exists in the tag master.
taglink1x Joins together tag data that exists in the tag master.
taglink2 Joins together tag data that exists in the tag master.
taglink2x Joins together tag data that exists in the tag master.
tagljoin1 The longest prefix key matching version of tagjoin1.
tagloopj loopj command for tag files
tagloopk loop of taglink3
tagloopkx loop of taglink3x
tagloopx Join by all possible combinations.
tagmap Converts a tag file list to a matrix with row and column headings
tagmax Calculates the maximum value of records with the same key value
tagmin Calculates the minimum value of records with the same key value
tagmrg Merge characters into a template
tagmsort In-Memory Sort for tag files
tagpad0 Add zeros to the beginning
tagpsort Partial Sort for tag files
tagrank Add a rank
taground Round, round-up or truncate
tagself Outputs data from the specified field of a tag file.
tagselr Selects rows that match exactly
tagsm2 Sum values in a tag file by key
tagsm4 Inserts subtotal lines.
tagsm5 Output the grand total
tagsorter Split a file based on a key
tagunmap Restore a file that was tagmapped to its original format
tagup3 up3 using tags
tagupl Merges two files on the same key field and then extracts

Development Support

bconv Converts a text into a binary data.
bedit Binary Editor
decomment Delets comments.
man2 Display the manual page for a USP command
xb XML beautifier
xdump Displays a hexadecimal dump of a file

Other

email SMTP client (mail sending client)
mcrypt MD5 encrypt
semwait Wait until the specified file exists
ulock Exclusive access control command