|
|
|
|
TaskMaster Lite (TMLite)
Frequently Asked Questions (FAQs)
The following topics cover the most Frequently Asked Questions (FAQs) regarding TaskMaster / TaskMaster Lite... |
| Frequently Asked Question (FAQ) Topics | |
| ABORT | How to terminate Extended Console Commands and Active Tasks |
| Alias Variables | Assign an Alias name to a Dynamic Variable (%VAR00% - %VAR99%) |
| Current Working Directory (CWD) | Understanding the Current Working Directory (CWD) |
| Dynamic Variables | Uses for / limits of %0 - %9 & %VAR00% - %VAR99% Dynamic Variables |
| Full versus Lite | What is the difference between TaskMaster and TaskMaster Lite (TMLite)? |
| Name Space Support | Support caveats of DOS, Long (OS/2), Mac, & NFS Name Space Support |
| Output Redirection | Redirecting screen output to a log file |
| Registration / Serialization | How can I find the Registration information / Serial Number? |
| TMConsole (Shell) | Overview of the TMConsole (Shell) |
| » Disable / Enable | How to Disable (close) and Enable (open) the TMConsole (Shell) |
| » Quick Access | Quick access to the TMConsole (Shell) from a Server System Console |
| » Sending commands | Send commands to TMConsole (Shell) from the System Console or .NCF batch |
| TMRemote DOS Client | Overview of the TMRemote DOS Remote Console Client |
| TMSMTP (SMTP Send Mail) | Unable to locate SMTP Host error |
| TMUNLOAD / TMRELOAD | Proper way to UNLOAD / RELOAD the TaskMaster NLMs |
| Troubleshooting | Operational & Performance Issues |
| » AttachToFileServer() Error | Attempts to communicate with a Remote Server fail |
| » Broadcom Gigabit Performance Issues | Performance Issues Attributed To Broadcom Gigabit B57 / Q57 Driver Bugs |
| » Large Directory Performance | SxCOPY / SYNC / xCOPY slower to/from large directories (+12K dir/file entries) |
| » NSS Performance | SxCOPY / SYNC / xCOPY to NSS volumes slower than to TFS volumes |
| » Pure-IP Performance | LAN / WAN: <Pure-IP> vs. <IPX> |
| » SxCOPY / SYNC Performance Tuning | Bandwidth and Speed - Optimized SET Parameters |
| » User Experience: UDP vs. NCPE | An Unofficial Guide to Tuning & Troubleshooting TaskMaster (UDP) |
|
|
|
| Additional Information / Support Links | |
| General FAQ: | Frequently Asked Questions (FAQs) about avanti's products. |
| TaskMaster SYNC FAQ: | Frequently Asked Questions (FAQs) about TaskMaster's SYNC command. |
|
|
|
| TaskMaster Batch Reference: | Batch Commands / Scripting Language Quick Reference for TaskMaster / TMLite. |
| TaskMaster Command Reference: | Extended Console Commands Quick Reference for TaskMaster / TMLite. |
| TaskMaster Manual (Complete): | Latest Electronic Copy (.PDF) of the TaskMaster / TMLite User's Guide |
| TaskMaster Sample Tasks: | Example Tasks for TaskMaster / TMLite |
| TaskMaster Tips & Tricks: | Tips & Tricks for TaskMaster / TMLite Commands & Tasks |
|
What is the difference between TaskMaster and TaskMaster Lite (TMLite)?
TaskMaster is a network-centric product which includes Server-to-Server
command, communications and control (data transfer and task automation),
as well as multi-session, secure Remote Console support via the TMRemote
DOS Client and file replication / data synchronization through the
SYNC command.
TaskMaster Lite is Server-centric and only capable of automating or
processing tasks on a single Server autonomously (i.e., it cannot perform
any communication or data transfers between Servers, does not include
Remote Console support nor the SYNC command).
TaskMaster Lite can be used to automate tasks on a single Server while
TaskMaster (full) is used for automating tasks involving the transfer of
data between Servers (typically for file replication / data synchronization
using the SYNC command).
Because TaskMaster's Extended Console Commands support wild cards and, in
most cases, can be used recursively to traverse a subdirectory tree, there
may come an occassion when it might be desireable or even necessary to want
to terminate (or abort) the processing prior to completion.
For that reason, one of the common commands between the TMConsole (Shell)
Extended Console Command set and the Batch Processing script language is
the ABORT command.
Within a TaskMaster processed task (CALLed, TMRUN executed, or scheduled), the ABORT command, without any specification as to a command or task name, terminates the active task. The ABORT command can also be used, either within a task script or at the TMConsole (Shell) prompt, to terminate an active task or terminate processing for most of the Extended Console Commands.
Terminating a task:
ABORT {task}
where {task} is the DOS 8.3 file name of the active task.
Terminating a command:
ABORT {command}
where {command} is the name of a supported Extended Console
Command that is in process.
Current Working Directory (CWD)
The TMConsole (Shell) command prompt, as well as each individually processed
task, maintain their own Current Working Directory (CWD).
The CWD is the default directory that is searched for any file system
request which does not include a volume and path (VOL:\PATH) in the
specification.
The concept is similar to the default directory on a workstation with the following exceptions:
..
to specify a level higher in the tree or . to represent
the CWD.
The enhanced Batch Processor incorporated into TaskMaster / TaskMaster Lite
includes a set of Dynamic Variables (i.e., blocks of memory that can be used
to represent, retrieve and store data) which are supported in two formats:
%0 - %9 and %VAR00% - %VAR99%.
It should be noted that %0 - %9 and %VAR00% - %VAR09% represent the same
set of Dynamic Variables (i.e., %0 = %VAR00%, %1 = %VAR01% ... %9 = %VAR09%).
The overlap in naming is a result of backwards compatibility support for the
original 10 Dynamic Variables (%0 - %9) which have since been expanded to
100 Dynamic Variables (%VAR00% - %VAR99%).
These variables can be used to represent and substitute data in place of
hard coded values for conditional tests, logging and display.
Data can be stored in these variables using a variety of Batch Commands:
Multi-OS support for DOS, Long (OS2 / Windows), Macintosh OS (Apple) and
NFS (Unix) Name Spaces is inherent, unless documented to the contrary
with maximum combined full path (including file name and extension)
lengths of up to 511 characters.
For full Name Space support to be available, the appropriate Name Space
support NLM must be loaded on the Server (both source and destination
Servers for Server-to-Server operations):
Support for non-DOS Name Spaces is similar to the support for the Long (Win32) Name Space in a DOS box under Windows 95 / 98 / NT / 2000 with the DOS Name Space as the default and spaces within a command assumed to be command line item separators. To specify a non-DOS name containing one or more spaces within a command, the entire non-DOS specification must be enclosed in double quotes ("").
COPY "SYS:\Program Files\*.*" "BACKUP:\Program Files" COPY "SYS:\Program Files\*.*" BACKUP:\PROGA~1
According to the standards (or rules) for Windows Long Name Space support (the most widely used Long Name Space implementation), directory and file names may contain up to 215 characters, including spaces but excluding the following characters: Forward slash (/), backward slash (\), colon (:), greater than sign (>), less than sign (<), vertical bar (|), double quotes ("), asterisk (*), and question mark (?). The colon (:) is reserved for use as the drive or volume (NetWare) separator while backward slashes (\) are reserved for use as the UNC or path separator. The forward slash (/) is also reserved and considered a path separator for compatibility with NetWare and Unix NFS File Systems. All of the other reserved characters serve special purposes in DOS, Windows, and Unix command line processing so they are not supported in directory or file names.
According to the standards (or rules) for the Macintosh File System, the only restricted character in a file or folder (directory) name is the colon (:) which is reserved for use as a path separator. Characters normally used as wild cards in other Operating Systems, such as the asterisk (*) and question mark (?), can be used within a file or folder (directory) name. Characters which have special meanings on many Operating Systems, such as greater than (>) and less than (<) signs often used for input or output redirection, or double quotes (") commonly used to enclose a specification with embedded spaces and the ampersand (&) widely used widely in internet applications as an options separator on the command line, are valid with a file and folder (directory) name. In addition, forward slashes (/) which are reserved as a path separator by both NetWare and NFS standards (or rules), as well as backward slashes (\) which are reserved as a path separator by DOS, Long (Windows), and NetWare, are allowed in Macintosh file and folder (directory) names. The only real limitation is that a file or folder (directory) name cannot contain more than 31 characters (Mac OS prior to OS/X), but a full path can exceed the 255 character DOS limitation.
According to the standards (or rules) for the NFS File System, the only restricted character in a file name or path is the forward slash (/) which is reserved for use as a folder (path) separator. Characters normally used as wild cards in most Operating Systems, even for Unix commands, such as the asterisk (*) and question mark (?), can be used within a file or directory name. In addition, colons (:), which are used by DOS, Long (OS/2 / Windows), and NetWare to separate Drives/Volumes from Paths, can be used in file or directory names. NFS also allows backward slashes (\), greater than (>) and less than (<) signs, as well as double quotes (") and ampersands (&) to be used in file and directory names. Moreover, both file and directory names are handled as case sensitive, treating FILE, File, and file as three separate names. The only real limitation is a maximum of 255 characters per file or directory name allowing a full path to far exceed the 255 character DOS limitation.
Every effort has been made and will continue to be undertaken to insure
that TaskMaster / TaskMaster Lite can provide as comprehensive of support
as possible for all the special cases of each Name Space without being
limited to supporting a single Name Space (i.e., maintaining multi-OS
support is the Priority).
In that regard, there are likely to be some situations where file or
directory names will conflict with either the NetWare APIs used or the
multi-OS support logic and the entry will not be capable of being
processed by TaskMaster / TaskMaster Lite until it has been renamed.
To avoid potential Name Space caveats and conflicts, it is recommended
that multi-OS compatible rules be implemented for file and directory naming.
Ultimately, in any realm of conflict, it is often best to avoid such
problems by defining rules which embrace the path of least resistance
(i.e., the lowest common denominator, in this case the Long Name Space).
The following simple rules should provide a reasonable compromise that also insures directories and files are fully accessible and manageable across the network:
Name Space Support Caveats:
The TaskMaster command most affected by these caveats is the SYNC command.
How SYNC handles non-DOS entries
is covered in the
SYNC FAQ.
For more information on the caveats associated with Long Name Space support,
review the following document (Adobe Acrobat .PDF format):
To download Adobe's free Acrobat Reader, visit: http://www.adobe.com
Most of the Console command extensions provided by TaskMaster support
output redirection.
As in DOS programs, output redirection redirects the information output
to the screen by a program or command to the specified file, either in
truncation mode (
Redirecting Screen Output To A File:
>vol:\path\redirect.ext (truncates)
Note: The output file must reside on the local Server. The output file specification must be a valid file name (including a valid volume and path, if specified). The output file specification can be relative to the Current Working Directory (CWD). Wild cards are not supported.
There are two quick methods to retrieve the Registration information and Serial Number associated with a loaded TaskMaster NLM:
When the TaskMaster Master Server module (TASKMSTR.NLM) or TaskMaster Lite Server module (TMLITE.NLM) is loaded, a TMConsole (Shell) screen is automatically created on the Server. The TMConsole (Shell) provides an interactive user interface to TaskMaster and the TaskMaster Console Command extensions (refer to the Console Commands chapter later in this manual). The combination of the TMConsole (Shell) interface and TaskMaster's Console Command extensions is intended to emulate a DOS command shell (or DOS box under Windows) providing direct command line management of the directories and files stored on volumes mounted on the local Server. TaskMaster's Console Command extensions also include commands for configuring and managing TaskMaster, as well as performing operations against Remote Servers which are running compatible versions of the TaskMaster NLM.
Entering EXIT at the TMConsole (Shell) prompt will close the active screen. To re-activate an inactive TMConsole (Shell) prompt, enter TMCONSOLE at the Server System Console.
Quick Access to the TMConsole (Shell) from a Server System Console
Send Commands to the TMConsole (Shell) from the System Console
or a .NCF Batch File
TMCONSOLE [command_line]
Example: TMCONSOLE TMRUN SUBTASK.TSK
When executed either from the Server's System Console or within a NetWare .NCF batch file, the TMRUN SUBTASK.TSK
command will be executed as if manually entered at the
TMConsole (Shell) prompt.
TMRemote DOS Remote Console Client
TaskMaster includes a TMRemote DOS Client (TMREMOTE.EXE) which functions
both as a Bindery / NDS-compliant, secure, and lower overhead Remote
Console alternative and as a means to provide a defined group of Users
with the capability to launch TaskMaster tasks and/or submit commands
to the Server Console via a manually executed DOS program or integrated
within a workstation batch process.
TMRemote utilizes NCP Extensions (NCPE) as its method of communication
with the TaskMaster NLM on the Server.
By utilizing NCPE instead of SPX, TMRemote consumes less bandwidth and
overhead than Novell's RCONSOLE and supports any workstation which can
execute DOS programs so long as the workstation has an established NCP
attachment to the Server via a Novell NetWare Client, regardless of the
protocol used or whether a local or remote (WAN) connection.
Initial Program Load
Depending upon how the Remote Console Rights are defined (refer to the
TMCONFIG Console Command extension), the User may be granted full
or limited access to the remote Server (based upon the highest rights
granted to User and the defined Remote Console Rights for such rights).
If the User does not have any of the listed rights, the connection is denied.
Defining TaskMaster Operators / TaskMaster Users
A TaskMaster User can submit tasks to the Server and may be granted
view only Remote Console access.
TaskMaster Users are defined via the TMCONFIG Console Command extension.
Remote Console Access
The following listings outline the supported Remote Console access modes
that can be granted to each level of User rights:
Admin/Supervisor File Server Console Operator TaskMaster Operator
Command Line Options
Server S=Server
Unrestricted Access rights required.
Admin/Supervisor, TaskMaster Operator, or TaskMaster User rights required.
Unrestricted Access rights required.
The most common source of the 'Unable to locate SMTP Host' error is an address or name resolution issue. To avoid such errors, make sure the following have been properly defined:
One of the most common reasons why the Server System Console prompt will
disappear is when an attempt is made to UNLOAD an NLM that has incurred
a Soft ABEND.
When a process generates a Soft ABEND, NetWare suspends the process to
avoid further corruption and places the process in a sleep state that
prevents it from being awakened even to be terminated.
Thus, since an NLM cannot be unloaded until every running process has
terminated, the UNLOAD command cannot complete and because the UNLOAD
command cannot complete, control does not return to the Server's System
Console command handler.
In an attempt to prevent the loss of the Server System Console prompt,
logic was added to TaskMaster v3.24 (and later) to prevent TaskMaster
from being unloaded via the Server System Console UNLOAD command.
To unload the TaskMaster NLM (TASKMSTR.NLM, TMSECURE.NLM, or TMLITE.NLM),
execute the TaskMaster command TMUNLOAD at either the TMConsole (Shell)
prompt or the Server System Console prompt.
TMUNLOAD will send termination requests to all active TaskMaster
commands and task processes.
It will then monitor the active commands and processes until it can confirm
that the NLM is in a safe state to be unloaded, at which point the NLM will
automatically unload.
In most cases, the NLM will unload in just a few seconds.
If the NLM does not automatically unload within five (5) minutes, most
likely it will be necessary to DOWN the Server to unload the NLM safely.
Related TaskMaster Commands:
TMUPDATE can be used to automatically distribute updates between
licensed Servers.
It utilizes the TMRELOAD command to unload
and then reload the remote Server copy of the TaskMaster NLM.
(Note: TMUPDATE is not supported by TaskMaster Lite.)
AttachToFileServer() errors occur when TaskMaster attempts to establish
a communications route between the Servers, even before it determines if
there is a compatible TaskMaster NLM loaded on the Remote Server.
Such errors are usually communications related, the result of RIP/SAP or
SLP problems.
For TaskMaster Server-to-Server communications to work in a Pure-IP
environment, SLP must be configured properly allowing the two Servers
to see and communicate with each other.
This status can be verified by typing
'
For TaskMaster Server-to-Server communications to work in an IPX environment,
be sure not to filter SAP/RIP packets from other segments.
To verify that the Servers can communicate via IPX, type
'
Once the appropriate configuration changes have been made, it may still
require a bit of patience before the information fully propagates to the
Known Server table of the local Server.
This is a DS issue and may be hindered by DS anomalies and update conflicts.
Directories with a large number of entries (12,000 or more subdirectories
and files) can experience a significant performance hit due to NetWare's
underlying dependency on the DOS file system and DOS' inherent limitations.
Novell has an excellent Technical Information Document (TID) discussing
this issue and ways to minimize the impact:
Slow file system performance in a directory with excessive files -
Novell TID 10021744
If the TID becomes obsolete or is updated so that it cannot be found via
the provided link, try searching the Knowledgebase using the keywords:
Slow File System Performance Excessive Files
While offering many benefits over traditional volumes, NSS volumes
can deliver much slower file copy speed if not configured properly.
Novell has several excellent Technical Information Documents (TID)
covering conflicts and performance tuning tips for NSS volumes:
Monitoring NSS Performance -
Novell TID 10068489
Optimizing NSS and the storage system for different usage patterns -
Novell TID 10095637
Performance, Tuning and Optimization -
Novell TID 10012765
Poor performance reading files from an NSS volume -
Novell TID 10072922
Resolving GroupWise performance issues with NSS volumes -
Novell TID 10065215
Slow backup/restore performance tuning parms parameters for NSS -
Novell TID 10093351
The following facts and Novell Technical Information Documents (TIDs) are relevant when trying to troubleshoot performance degradation which may be encountered when using TaskMaster:
SxCOPY / SYNC On Broadcom Gigabit Ethernet
Sites have reported encountering erratic performance with SYNC and SxCOPY
when using UDP on Servers which have NICs that utilize the Broadcom Gigabit
Ethernet chipset (prevalent in both embedded NICs on Compaq, Dell and HP
systems, as well as NICs from 3Com, Compaq, HP and others).
The problem has been traced to B57.LAN and Q57.LAN drivers for the
Broadcom Gigabit Ethernet chipset.
It appears that drivers prior to v8.65 have a problem with corrupted
checksums being generated for fragmented UDP packets that results in
packets being discarded as corrupt which causes long transmission delays
and/or communications time out errors.
The following quick test can be performed to check the drivers in use to
determine with certainty if the problem exists:
Load the PING.NLM on a NetWare Server with the B57.LAN or Q57.LAN driver
loaded and try to PING another Server with the same driver loaded using
the following packet sizes (allow each packet size test to run for at
least 15 seconds):
4460
Problem drivers will encounter dropped packets and/or a much slower response
time for the 4464 and 4760 byte packets.
There is no reason such packet sizes should cause problems unless the driver
is not processing them correctly.
In addition to these issues, some other problems have been reported with the
B57.LAN and Q57.LAN drivers that do not appear to have been fully resolved
until the v8.65 release...
Duplicate MAC Addresses and UDP issues with Broadcom B57 and Q57 Cards
- TID10076183 (last modified 20MAY2003)
Communication problems after applying NW51 sp5 or NW6 sp2.
- TID10074067 (last modified 23JUN2003)
At last check, the Broadcom support site only has the v8.60 drivers
(included in NetWare v6.5 SP3/SP4/SP5, NetWare v6.0 SP5 and NetWare v5.1 SP8).
However, the following vendor specific WEB Sites have the v8.65 available:
Compaq / HP B57.LAN v8.65
IBM B57.LAN v8.65
Using the /+NCP SYNC option avoids the conflict since TCP is typically
the IP transport for NCP in a Pure-IP environment and packet fragmentation
is managed by other than the UDP protocol.
Using /+IP=#### SYNC option (where #### specifies a packet size of 4 KB or
less - i.e., either 1-4 [KB] or 1024 - 4096 [bytes]) can also be used to
minimize the conflict since fragmentation becomes much less of an issue.
However, either option reduces throughput versus applying the updated drivers.
Ultimately, the best solution is to update to the latest B57.LAN / Q57.LAN
drivers (v8.65 at the minimum).
Feature Comparison: SYNC versus RSYNC Bandwidth and Speed It is important to note that stated bandwidth speed is a theoretical maximum and not guaranteed as sustainable. In fact, sustaining anything above 60% of the stated bandwidth on Ethernet is most often considered efficient throughput due to Ethernet's design and collison avoidance overhead. Even if it were possible to consistently sustain maximum throughput on a 1 Mbit rated WAN link and use it for data transfer only (i.e., no IP packet headers, protocol IDs, acknowledgements, replies/result codes, API headers, file indentifiers, data offset pointers or CRC/Checksums), the result would be a 128 KByte / second transfer rate. That throughput would only happen IF there were NO OVERHEAD (communications or application) and 100% of the stated bandwidth could be sustained for data transfer purposes only.
Of course, such a scenario would essentially be useless since there would
be no overhead allowed for directing the data packets to an IP address and
port nor for designating a file / offset into which the data should be
stored nor any checks for data integrity or recovery from dropped packets.
The ultimate scenario, though fast, provides no integrity, much less purpose.
TaskMaster Server-to-Server file copy operations do more than just stream
data across the link.
The additional bandwidth (i.e., over that required for just the data)
required to insure completeness, integrity and reliability of the file
copy process is an integral part of TaskMaster's design.
The DOS and non-DOS Name Space names are also synchronized, along with
the Ownership, Trustees, all date/time stamps, attributes, IRMs, etc.
Streaming the data is the most efficient and bandwidth consuming portion
of the file copy operation but it is only part of the overall amount of
information exchanged. The other packets tend to be small in nature, thus
lowering bandwidth utilization and efficiency during their exchanges.
In an effort to be as efficient as possible with the bandwidth available,
dynamic, real-time Compression and Block (Delta Change) Update logic
has been designed into TaskMaster's data transfer routines.
When Compression is enabled (default), the size of the streamed data
packets tend to be reduced to as little as 12% of the original data
size with a fractionally larger gap in time between data streams for
the compression and decompression operations.
When Block (Delta Change) Update is enabled (default), the remote file
is pre-read with only the CRC value for the pre-read block exchanged
creating a scenario of a lot of small packets rather than streamed data.
Both of these features help maximize bandwidth efficiency by minimizing
the amount of data actually transferred.
During SYNC operations, it is also important to note that TaskMaster must
retrieve directory listings from the Remote Server to be used in determining
which files need to be added, created, deleted and updated between Servers.
Not only is this a different type of data transfer but time to compare the
directory listings, create/open and delete the directories/files are
activities affecting the data transfer rate.
With these same facts in mind, it is easier to understand why TaskMaster
is not likely to either achieve or sustain maximum bandwidth during data
transfers.
Raw speed is not an advantage that TaskMaster touts over the basic file
copying capabilities built into a Client OS'.
The main advantage offered by TaskMaster will always be the automation of
the processing, the efficiency with which it occurs, the integrity of the
data transfer, the automatic support for NetWare file attributes /
ownerships / trustees / etc., and the added security provided by
Server-to-Server operations versus Client based utilities.
Optimized SET Parameters
Directory Caching (NW v5.0 / 5.1) Common File System (NW v6.0 / 6.5)
SET Maximum Concurrent Directory Cache Writes = 500
Note: Default value is based on older, slower disk technology. Reference: Novell TID 10065644 Directory Caching (NW v5.0 / 5.1) Traditional File System (NW v6.0 / 6.5)
SET Maximum Directory Cache Buffers = 4000
Reference: Novell TID 10012765 & Novell TID 10021744
Disk
SET Enable Disk Read After Write Verify = OFF
Note: ON forces NetWare to re-read data after each write for verification. Redundant since most Disk Drives have this feature built-in.
File Caching (NW v5.0 / 5.1) Traditional File System (NW v6.0 / 6.5)
SET Maximum Concurrent Disk Cache Writes = 2000
Note: Default value is based on older, slower disk technology. Reference: Novell TID 10065644 NCP
SET Client File Caching Enabled = OFF
Reference: Novell TID 10095627 & Novell TID 10085688 & Novell TID 10094172
NSS
SET NSS Cache Balance Percent = 85
Reference: Novell TID 10012765 & Novell TID 10065215 TCP
SET TCP Delayed Acknowledgement = OFF
(NW v5.1 SP3 & later / NW v6.x)
SET TCP Delayed Ack = OFF
(NW v5.1 SP2a & before / NW v5.0)
Reference: July 2002 Novell AppNote & Novell TID 10061174 & Novell TID 10061307 & Novell TID 10068360
After making any of the recommended changes to the SET Parameters, always be sure to issue the FLUSH CDBE command at the
Server System Console prompt to save the changes to the NetWare Registry.
|
|||||||||||||||