NAME
tagcoll − Perform various operations on a tagged collection
SYNOPSIS
tagcoll [options] <command> [options and arguments]
DESCRIPTION
tagcoll is a commandline utility to manage tagged collections.
A tagged collection is a set of items in which each item is associated with a set of zero or more tags, in no particular order.
tagcoll can take a tagged collection and perform various complex operations on it, like applying transformations, finding implicit implications between tags and building a smart intuitive hierarchy to navigate the items.
COMMANDS
tagcoll
accepts a non-switch argument, that indicates what is the
operation that should be performed:
help [command]
With no arguments, print a summary of available commands. If given a command name as argument, print detailed informations about that command.
copy or cat [files...]
Output the normalized collection on standard output, applying transformations if requested. This is the default action if no other switches are provided. A normalized collection is a collection in which an item appears in just one line.
reverse [files...]
Output the inbound collection
"reversed" from the tags point of view, that is,
associating to each tag the list of items associated to it
in the input.
The −−untagged−tag switch can be used to
provide a name to which untagged items will be associated in
the output.
diff <file1> <file2>
Output a tag patch file with
the differences between two files (requires two file
arguments).
The output tag patch file can then be applied when reading a
collection with the −−patch−with
option.
related <item> [files...]
Output a list of the items that
are related to the given item or list of items. If more than
one items are to be specified, separate them with commas.
The −−distance option can be used to control how
closely related the output items shold be from the item(s)
specified.
implications [files...]
Output a list of all implicit
implications between tags contained in the hierarchy.
Implication is defined such that tag A implies tag B if
every item tagged with A is also tagged with B.
Implications can be used to discover implicit hierarchical
relationships between tags.
The output is one line per tag, with just tags that have
implications, with the name of the package, a colon and a
comma−separated list of all implied tags.
hierarchy [files...]
Organize the collection in an
intuitively navigable hierarchy. The output is one line per
package, with the package name prepended by the path to the
item in the hierarchy.
A detailed description of the hierarchy generation algorithm
is found in the tagbk−draft.pdf draft paper available
in this package; if you want to understand what are the
goals of the algorithm and how it works, please give it a
read.
cleanhierarchy [files...]
Like hiearchy, but in every node it merges tags which are attached to the same set of items.
dischierarchy [files...]
The tree starts with an empty tag set, and branches with the most discriminant tags.
findspecials [files...]
generate a smart hierarchy and print, for each toplevel tag, what are the items that make it toplevel instead of going below another tag
grep <expression> [files...]
output the collection of tags that match the given tag expression
test [files...]
perform internal tests and timings
OPTIONS
This program follows the usual GNU command line syntax, with long options starting with two dashes (’−’).
Every one of the commands listed above has its own set of options. To keep this manpage readable, all the options are presented together. Please refer to "tagcoll help command" to see which options are accepted by a given command.
Help options:
−h, −?, −−help
print commandline help and exit.
−−version
print the program version and exit.
−−manpage=[hooks]
output the tagcoll manpage and exit.
Options for
command help
Options for command copy
Options
controlling transformations of input data:
−−derived=expand derived tags using the
given list
−−implications-from=use an external list
of implications
−−rename-from=rename tags using the given
mapping list
−p apply patches from the given tag patch
file, −−patch-with=apply
patches from the given tag patch file,
−−patch=apply patches from the
given tag patch file
−−remove-unfaceted=while parsing, remove
all tags with no facet part
−−remove-tags=<expression>
while parsing, remove all tags matching the given tag expression.
Options
controlling transformations of output data:
−g, −−group,
−−group-items
group items with the same tagset in the output collection.
−−redundant
when implications are provided, expand them explicitly in the output.
−i, −−items
output only the names of the items, without the tags.
−c, −−count
output the count of tags instead of the tags.
Options for command reverse
Options
controlling transformations of input data:
−−derived=expand derived tags using the
given list
−−implications-from=use an external list
of implications
−−rename-from=rename tags using the given
mapping list
−p apply patches from the given tag patch
file, −−patch-with=apply
patches from the given tag patch file,
−−patch=apply patches from the
given tag patch file
−−remove-unfaceted=while parsing, remove
all tags with no facet part
−−remove-tags=<expression>
while parsing, remove all tags matching the given tag expression.
Options
controlling transformations of output data:
−g, −−group,
−−group-items
group items with the same tagset in the output collection.
−−redundant
when implications are provided, expand them explicitly in the output.
−i, −−items
output only the names of the items, without the tags.
−c, −−count
output the count of tags instead of the tags.
Other options:
−−untagged-tag=<tag>
set item name to use for
associating untagged items when using the
"reverse" command. If not specified, untagged
items are not included in the output. Options for command
diff
Options for command related
Options controlling transformations of input data:
−−derived=expand
derived tags using the given list
−−implications-from=use an external list
of implications
−−rename-from=rename tags using the given
mapping list
−p apply patches from the given tag patch
file, −−patch-with=apply
patches from the given tag patch file,
−−patch=apply patches from the
given tag patch file
−−remove-unfaceted=while parsing, remove
all tags with no facet part
−−remove-tags=<expression>
while parsing, remove all tags matching the given tag expression.
Other options:
−d <val>,
−−distance=<val>
set the maximum distance to use for the "related" command (defaults to 0). Options for command implications
Options controlling transformations of input data:
−−derived=expand
derived tags using the given list
−−implications-from=use an external list
of implications
−−rename-from=rename tags using the given
mapping list
−p apply patches from the given tag patch
file, −−patch-with=apply
patches from the given tag patch file,
−−patch=apply patches from the
given tag patch file
−−remove-unfaceted=while parsing, remove
all tags with no facet part
−−remove-tags=<expression>
while parsing, remove all tags matching the given tag expression.
Options for command hierarchy
Options
controlling transformations of input data:
−−derived=expand derived tags using the
given list
−−implications-from=use an external list
of implications
−−rename-from=rename tags using the given
mapping list
−p apply patches from the given tag patch
file, −−patch-with=apply
patches from the given tag patch file,
−−patch=apply patches from the
given tag patch file
−−remove-unfaceted=while parsing, remove
all tags with no facet part
−−remove-tags=<expression>
while parsing, remove all tags matching the given tag expression.
Options
controlling generation of tag hierarchies:
−−flatten-threshold=<val>
set the number of total items below which a branch is flattened when using the "hierarchy" command (defaults to 0, meaning "don’t flatten").
−f <val>, −−filter=<val>
filter out the tags with cardinality less than the given value (defaults to not filter; currently only works when building hierarchies).
Options for command cleanhierarchy
Options
controlling transformations of input data:
−−derived=expand derived tags using the
given list
−−implications-from=use an external list
of implications
−−rename-from=rename tags using the given
mapping list
−p apply patches from the given tag patch
file, −−patch-with=apply
patches from the given tag patch file,
−−patch=apply patches from the
given tag patch file
−−remove-unfaceted=while parsing, remove
all tags with no facet part
−−remove-tags=<expression>
while parsing, remove all tags matching the given tag expression.
Options
controlling generation of tag hierarchies:
−−flatten-threshold=<val>
set the number of total items below which a branch is flattened when using the "hierarchy" command (defaults to 0, meaning "don’t flatten").
−f <val>, −−filter=<val>
filter out the tags with cardinality less than the given value (defaults to not filter; currently only works when building hierarchies).
Options for command dischierarchy
Options
controlling transformations of input data:
−−derived=expand derived tags using the
given list
−−implications-from=use an external list
of implications
−−rename-from=rename tags using the given
mapping list
−p apply patches from the given tag patch
file, −−patch-with=apply
patches from the given tag patch file,
−−patch=apply patches from the
given tag patch file
−−remove-unfaceted=while parsing, remove
all tags with no facet part
−−remove-tags=<expression>
while parsing, remove all tags matching the given tag expression.
Options
controlling generation of tag hierarchies:
−−flatten-threshold=<val>
set the number of total items below which a branch is flattened when using the "hierarchy" command (defaults to 0, meaning "don’t flatten").
−f <val>, −−filter=<val>
filter out the tags with cardinality less than the given value (defaults to not filter; currently only works when building hierarchies).
Options for command findspecials
Options
controlling transformations of input data:
−−derived=expand derived tags using the
given list
−−implications-from=use an external list
of implications
−−rename-from=rename tags using the given
mapping list
−p apply patches from the given tag patch
file, −−patch-with=apply
patches from the given tag patch file,
−−patch=apply patches from the
given tag patch file
−−remove-unfaceted=while parsing, remove
all tags with no facet part
−−remove-tags=<expression>
while parsing, remove all tags matching the given tag expression.
Options
controlling generation of tag hierarchies:
−−flatten-threshold=<val>
set the number of total items below which a branch is flattened when using the "hierarchy" command (defaults to 0, meaning "don’t flatten").
−f <val>, −−filter=<val>
filter out the tags with cardinality less than the given value (defaults to not filter; currently only works when building hierarchies).
Options for command grep
Options
controlling transformations of input data:
−−derived=expand derived tags using the
given list
−−implications-from=use an external list
of implications
−−rename-from=rename tags using the given
mapping list
−p apply patches from the given tag patch
file, −−patch-with=apply
patches from the given tag patch file,
−−patch=apply patches from the
given tag patch file
−−remove-unfaceted=while parsing, remove
all tags with no facet part
−−remove-tags=<expression>
while parsing, remove all tags matching the given tag expression.
Options
controlling transformations of output data:
−g, −−group,
−−group-items
group items with the same tagset in the output collection.
−−redundant
when implications are provided, expand them explicitly in the output.
−i, −−items
output only the names of the items, without the tags.
−c, −−count
output the count of tags instead of the tags.
Other options:
−v, −−invert-match
invert the sense of matching, to select non-matching lines.
−q, −−quiet
do not write anything to standard output, but exit with 0 if any match is found. Options for command test
Options controlling transformations of input data:
−−derived=expand
derived tags using the given list
−−implications-from=use an external list
of implications
−−rename-from=rename tags using the given
mapping list
−p apply patches from the given tag patch
file, −−patch-with=apply
patches from the given tag patch file,
−−patch=apply patches from the
given tag patch file
−−remove-unfaceted=while parsing, remove
all tags with no facet part
−−remove-tags=<expression>
while parsing, remove all tags matching the given tag expression.
Format of the tagged collection input
A sequence of lines describing the tagged items. Order of tags does not matter. Each line starts with the item name, optionally followed by tag names.
Tag names are separated by the item name by a colon and one or more spaces or tabs.
Tag names are separated by each others using a comma followed by one or more spaces.
Item names can contain colons, but not followed by a space or tab, and cannot end in a colon. "ui:gnome" is ok, "ui:" is not.
Tag names can contain commas, but not followed by a space, and cannot end in a comma. "cult,religion" is ok, "cult," is not.
An item with tags tag1, tag2, ..., tagN is represented as:
item: tag1, tag2, ..., tagN |
An item with just tag1 is represented as:
item: tag1 |
An item without tags is represented as:
item: |
or just as:
item |
An example input:
mutt: clients/mail/net | |
sylpheed: clients/mail/net | |
procmail: filters/mail/net | |
spamassassin: filters/mail/net | |
spamfilter: filters/mail/net | |
bulkmail: lists/mail/net | |
mailman: lists/mail/net | |
smartlist: lists/mail/net | |
xeukleides: educational | |
new-package-not-yet-categorized: | |
another-uncategorized |
Format for the explicit implications input
The format for the explicit implications is the same as the one for the tagged collection: put the name of a tag at the left of the colon and the names of the tags it implies to the right.
Example:
C: language, devel | |
gnome: gui, ui, x11 |
Format for the rename mapping input
The format for the rename mappings is the same as the one for the tagged collection: put the new name of the tags at the left of the colon and the names of the old tags to be renamed on the right.
Example:
mp3: MP3 | |
language: languages, devel::language, devel::languages |
Format for the tag patch file
The format for the rename mappings is the same as the one for the tagged collection, but the tags are listed prepended with a ’+’ or ’-’ sign. A tag prepended with a ’+’ sign is added to the item, while a tag with a ’-’ sign is removed from it.
Example:
cappuccino: +essential | |
emacs: +otheros, -editor |
Format for the derived tag list
The format for the derived tag list is a line-oriented format with a derived tag per line. The derived tag name starts as the begining of the line and is separated by his tag expression by colon and space, just like the tagged collection items.
The tag expression is an expression composed of tags and the operators ’&&’ (and), ’||’ (or), ’!’ (not) and the parenthesis ’(’ and ’)’.
Example:
userlevel::novice: !specialized && (interface::gui || interface::curses) |
The tag at the left of the colon is added when the set of tags of an item matches the expression at the right of the colon.
EXAMPLES
# Output the
collection in normal form
tagcoll copy collection-file
# Output the
items associated to a given tag
tagcoll reverse collection-file | grep ^tag:
# Produce tag
patch data describing the tag difference between two
collections
tagcoll diff coll1 coll2
# Apply a tag
patch file to coll1
tagcoll --patch-with=tagpatch copy coll1 >
collection-file
# Show the
minimal set of implicit implications contained in the
collection
tagcoll implications collection-file
# Show the
implicit implications contained in the collection, fully
expanded
tagcoll --expanded-output implications collection-file
# Build a smart
hierarchy with the collection
tagcoll hierarchy collection-file
# Build a
cleaner smart hierarchy with the collection (yoy might like
to tweak
# the parameters)
tagcoll -f 5 --flatten-threshold=5 cleanhierarchy
collection-file
# Apply some
transformations to the collection and build a smart
hierarchy with
# them
tagcoll --implications-from=explicit-implications-file \
--rename-from=rename-map \ | |
--patch-with=patch-file \ | |
hierarchy collection-file |
# Merge the
contents two collections
cat coll1 coll2 | tagcoll copy > merged
# Merge the
contents two collections and apply an external patch
cat coll1 coll2 | tagcoll --patch-with=patch-file copy >
merged
# Build a smart
hierarchy out of the implicit implications contained in the
# collection
tagcoll implications collection-file | tagcoll hierarchy
# Build a smart
hierarchy out of the combination of explicit implications
and
# the implicit implications contained in the collection
tagcoll --implications-from=explicit-implications-file \
implications collection-file | tagcoll hierarchy |
# Show all the
items similar to "mutt"
tagcoll related mutt collection-file
# Show all the
items similar to "mutt" and
"mozilla-browser"
tagcoll related mutt,mozilla-browser collection-file
# Show all the
items similar to "mutt", with at most two
differences
# in the tag set
tagcoll --distance=2 related mutt collection-file
SEE ALSO
The tagbk draft paper in /usr/share/doc/tagcoll.
AUTHOR
tagcoll is maintained by enrico [AT] enricozini.org.
This manpage has been automatically generated by the tagcoll program.