[Search for users] [Overall Top Noters] [List of all Conferences] [Download this site]

Conference azur::mcc

Title:DECmcc user notes file. Does not replace IPMT.
Notice:Use IPMT for problems. Newsletter location in note 6187
Moderator:TAEC::BEROUD
Created:Mon Aug 21 1989
Last Modified:Wed Jun 04 1997
Last Successful Update:Fri Jun 06 1997
Number of topics:6497
Total number of notes:27359

1243.0. "What is Topology?" by TOOK::MATTHEWS () Fri Jul 12 1991 17:49

I keep getting tripped up with questions of, Why isn't topology a user
interface issue rather than a general systems issue? OR isn't Auto-Topology
simply learning about the network and composing a reasonable map?

We all have our personal visions of network management.
On one end of the spectrum there are people whose vision is
NCP with a fancy iconic map user interface. At the other end
are expert systems which somehow magically understand
the normative topology of the network and how the current topology
deviates from the normative topology and can provide topology sensitive
inference and analysis. These systems monitor trends and predict
when additional capacity is necessary early enough so that it can
be ordered from your favorite TELCO "just in time" without ever causing
you to pay for wasted capacity but never having the network constricted
by too little capacity.

In some visions, topology is the configuration rules of the network
and the expert system must walk the network to determine the current
network topology (ie. the topological structure of the network is
distributed within the network). Others allow for discrete
models of the network which are kept up to date with the network which
can be analyzed to determine the network's topology.

Almost all systems to date have the topological rules of a particular
network topology hard wired into their applications. Others such as
NCP rely upon the user understanding the topology rules and fetching
the current instance from the various entities within the network.

My vision is somewhat different. I believe that there is a network
model which models the DECmcc MIR in many ways. There are rules for
connectivity much as the data dictionary maintains rules for the
structure of entities. For each kind of connectivity there is a
topology object. There are instances of each of these topology objects
which are maintained in an instance store much as the registration
space of DECmcc presently maintains instances of entities.
Collectively I call these
2 data structures the Network Topology Model. The instance portion
of the model, needs to keep multiple views of topology; the current
view, multiple past views, future views to track topology changes
over time so that analysis of current, historical, and projected
data can be analyzed in the correct topology context. In addition,
there are current, past, and future normative views that represent
the topological state of "how a network should be connected" 
at an instant in time.
Further, there exists many alternate network topological views. Each
is designed to change the network to correct an outage, allow for
a component to be serviced, or adjust to a new network operational
state.

I have seen multiple attempts at expert systems for network management.
All have failed. A major contributing factor in all cases was the lack
of a topology model of the network that could be used to make inferences.
If the only view that exists is the current network, then the expert
system has no way to check the current view against the normative view.
Quite often the problem that is being analyzed is that the current
view is not correct. More often, key topological knowledge is not
available on-line at all thus inferences that the expert can make
can not be automated. The usual way an expert system gets around
this is to ask the user for the missing information, thus the system
must be attended and interactive which undermines its usefulness. 
Providing a topological model is a basic building block for building
expert systems which use topology information in performing analysis
and making inferences.

Our current Network Maps are static presentation models of normative
view of a subset of a network. Only the devices supported by DECmcc
are shown on the model. Only the topology supported by DECmcc are shown.
User's compose their static model by manually composing their map.
Auto-topology is currently defined as running a utility program to
generate the original presentation model. On the other hand a dynamic
view would auto-compose the map from whichever view of the network
topology model that the user desires using user defined policies
for the presentation models.

So what is topology? What is configuration? How are they similar and
yet different? Intuitively, topology is how the elements of a network
are connected together. An analogy is the tinker toy sets that we
buy for our children for Christmas. They consist of a number of standard
types of pieces of which each set has an inventory of so many of each
type. For each piece there is a finite number of ways to interconnect
it with other pieces. There are a large number of structures that are
possible that can be built from these standard pieces using the limited
interconnection rules. The set usually comes with plans for 20 or 30 of
them. The number of possibilities are finite but very large and grow
very quickly with the addition of more pieces or of new types of pieces.
So for all practical purposes, other than mathematical dissertation, the
number of possible structures is infinite. A given structures topology
is the description of how the various pieces are connected.

Configuration is a more general term. To accurately define a network, one
needs to define more than its interconnections. 
For example, a connection uses a specific kind of cable which also has
a maximum bandwidth associated with it. A particular communication
technology utilizing that connection may have a range of bandwidths
that it can use. Which value is currently being used for a connection
is a part of the connections configuration but not its topology.

Configuration and topology may be inter-related. We may want to associate
configuration attributes with topological objects (ie. A circuit object
may have a bandwidth attribute). Or we may want to associate topology
information with the configuration of an object (ie. adjacent nodes
pointers in DECnet objects). Thus the distinctions between the 2 concepts
are somewhat fuzzy at best.



T.RTitleUserPersonal
Name
DateLines
1243.1Topology in an incremental scienceENUF::GASSMANSat Jul 13 1991 13:0224
    Wally, you are right, there are many aspects to topology.  I hope that
    DECmcc someday treats them all.  Ordering new bandwidth just in time
    would be a nice selling point.  However, I plead for attacking this
    problem one step at a time.  Please solve the simple problems quickly,
    then work on the more complex ones.  Don't wait until you have topology
    models in place - cause we have to compete against other simple
    solutions today.  Today's topology requirements is the ability to find
    who's there, who's connected to who - and draw a map that is close and 
    provides enough nice map editing tools to make it right.  IP is where
    most the advances are going on - but if you can do it with DECnet and
    DEC's bridges and FDDI that is great.  Very few vendors can detect
    changes in real time.  HP talks like they can - and I understand that
    you must employ lanprobes to make that feature work.  However, with
    smarthubs and the new lanprobes on the market (using 12mips risc
    processors), there is all sorts of information to input into your NMS's
    autotopology routines.  THIS DOES NOT SOLVE THE WHOLE PROBLEM!  However
    as other vendors solve some of the problems - MCC must keep up.  Some
    of the problem is being solved - and customers will buy the leaders
    that are solving what they perceive as 'problems being solved today'.
    This note has the same 'incremental' theme as the other one I just
    wrote.  Guess it's just something I think we need to understand and
    address before the Digital sales force can bring in our FY91 revenue.
    
    bill
1243.2We AINT WAITINGTOOK::MATTHEWSMon Jul 15 1991 19:5624
    re: .1
    Bill, who said we were waiting around until we solve the whole thing.
    We are working several parts of the problem in V1.2. We have people
    actively developing an automatic map generation tool. We have people
    building a CIRCUIT MM which implements the NMF Circuit. The circuit
    concept has simple topology structures inherent in it so that it
    can be used to model simple connectivity NOW. We are also adding
    to the Alarms FM a target entity capability, and adding to the
    iconic map a mechanism that allows us to use lines as icons.
    Collectively, we are adding a lot of simple pieces to the topology
    question in V1.2. 
    
    The plan is to phase topology in over multiple releases. We heard you
    many months ago. I think you misunderstood my motivation for placing
    the note in the file. 
    
    I want to share the vision of where we are going, so that we have that
    vision during the journey. I don't want us to think that our simple
    milestones are the ultimate end of the journey. I want us to make
    sure that we pursue simple things that lead to the end goal and are
    careful to not overzealously think that the simple solutions are all
    that is necessary.
    
    wally
1243.3decnet autotopology and cisco routersENUF::GASSMANThu Aug 08 1991 15:2410
    The MSU folks are shipping autotopology for both decnet and ip in their
    next release (October) and ran into an interesting problem.  Some of
    the field test customers have cicso routers - which support decnet
    routing, but you get at the routing tables using SNMP (no NICE support).
    The answer is obvious - either restrict it to DEC routers (not a
    marketable solution) or make the auto-topology routines flexible enough
    to ask for the routing info via NICE or SNMP.  How would MCC handle 
    this?
    
    bill
1243.4exiTOOK::JESURAJFri Sep 27 1991 15:5213
    There is a bit confusion between the terms auto-config and auto-toplogy.
    Both are parts of CONFIGUARTION management. Auto-config is to figure out 
    the configuration in an automated manner. Topology deals with 
    configurations and the relations among the entities that are configured. 
    Auto toplogy is to figure those relations along with the configuration
    in an automated manner.
    
    The product mentioned in .-1 is auto_config or auto-toplogy?
    
    Thanks.
    
    / Jay
    
1243.5A bit of both...LOGRUS::KELSEYWalking the Pattern...Mon Sep 30 1991 06:0014
Re: .-1
    
>    The product mentioned in .-1 is auto_config or auto-toplogy?

A bit of each really.  Given a single IP gateway or DECnet router, MSU's 
discovery function will do auto-config to determine the other IP gateways or
DECnet routers by essentially tracing routing (network) layer connectivity.
Thus the resultant map reflects the IP routing or DECnet network topology.

So by your definition, it does auto-config by determining other entities that
are part of the total configuration, and auto-topology by tracing network-layer
connectivity relationships to produce the resultant map.

Paul
1243.6This could be added unmatched added value.BEAGLE::WLODEKNetwork pathologist.Sat Oct 05 1991 12:40114
    The problem is actually not that difficult.

    There is in a network a distributed application running on all end
    nodes and routers ( my terms are very much DECnet but valid for
    TCP/IP as well) .This application detects new nodes, nodes going away
    and keeps track of best paths to other nodes.

    This application has all information to draw a complete topology of the 
    network .Depending on technology , there is one or few or a lot places that
    together keep this information.

    Topology here is meant as "logical topology", if you are on it, you are
    reachable. This application is called Network Layer or Routing.
    Creating logical topology map can be greatly simplified if one could
    ask routers for the databases. 

    In DECnet phase IV one can query every router about it's forwarding 
    database and adjacency database.

    Phase V link state packet database contains complete topology
    information for the router's area, but is not directly accessible.
    But it can be fixed ( a new NCL command to a router) or intercepted
    by an imaginary  "network management topology agent".

    This is enough to draw a DECnet network logical topology, but it is not
    enough to draw the physical topology , there are few problems here :

    - backup circuits that are usually down and that are brought up in case
      of emergency.

    - parallel circuits. I don't know a way of finding out which circuit is
      connected where in case of two parallel circuits between two routers.
    ( But there might be one it is on my "to do" list .-)   

    So , some manual fixing of a topology map cannot be avoided.

    There is another limitation of this approach, sometimes Routing doesn't
    know or doesn't exist , in this cases packets are just sent out and
    hopefully arrive at the destination. This is how DECnet routerless LAN
    works and how IP works in some cases.

    Usually, this is the case of LANs. There is no other way to know about 
    these system then to listen to the LAN. The systems might send a
    periodic ID messages or their traffic can be intercepted and address
    recorded, by our "network management topology agent". Bridge forwarding
    db can serve this purpose. In any cases, there is a need of a local piece 
    of equipment to help us .

    In summary, WAN problem is simple, routers keep all info. LAN problem
    is also simple in DECnet case. IP is harder but no hopeless if one can
    query bridge db or maybe IP router's db.


    Having a model of Network Layer fixes not only logical topology problem

    1. one can have new types of alarms, very important from network
    managers point of view . Network managers need not only know that a
    circuit is down, he must know the impact on logical topology and thus
    reachability. This may help him to make a bridge to business impact of
    a failure.

    	Possible new alarms :

    	- area reachability change
    	- partitioned area ( both phase IV and V problem )
    	- LAN router misconfigurations ( both phase IV and V problem )
    	- designated router wars
    	
    	If you think about it there are some DECnet entities today that are not
    	modeled anywhere ( an  area or a  LAN ).

    	2. Correct alarming "targets". 

    	Since routing knows that a "node down" event from a router says
    	something about the node not a router, right entity can be alarmed and 
    	right icon turn red.

    	3. Ease of use. 

    	Lots of "retargeting" events etc and definitions could be avoided
    	if all routing layer events were sent to routing. 

    	4. Network bandwidth saving.

    	Routing makes incredible effort to know who is out there and if
    	all nodes are reachable. So, if one could ask routers for
    	reachability tables, all expensive network polling could be avoided.
    	

	5. Today an the iconic map is an "arbitrary " integration point of
    	the logical topology, and thus all the problems of a static
    	definitions, Routing FM is the right place to control the topology
    	map correctness.

        						regards,
    						Wlodek

	ps. So what about bridges, repeaters , "delinis" and modems ?
    	It is important to keep right level of abstraction. All mentioned
    	components are layer 2 or 1. Mixing layers too much confuses
    	everybody, but still "some" mixing is necessary. If a bridge is
    	also an entity at Network layer ( a brouter or having a layer 3 for 
    	the sake of management, then some automated topology description
    	for this guy is possible, otherwise, we need a manual
    	intervention.)
    	
    	The manual fixing of topology will always be necessary, this is
    	something that network managers must be able to do.
    	One should concentrate on automating things that change fast,
    	like systems joining a LAN. The WAN lines take months to order and
    	don't change that fast ( yet..., wait for dynamic transmission
    	systems...) so it is not a big deal to manually define a Vitalink 
    	bridge or other transmission network component.
1243.7Auto-topology will never be easy.SUBWAY::REILLYMike Reilly - New York Bank DistrictMon Oct 07 1991 02:2855
    Note -1 got me thinking. I think we need to take a step back and
    see if we can present this auto-topology problem in a different way.
    There are two major requirments for true auto-topology.  Firstly we need
    a way of entering the rules that govern network topologies.  These
    rules will be protocol and media dependent.  The rules will be
    used to build a graph of the network in the management station.  One
    set of rules will specify the operation of the various types of
    nodes in the graph and a second set of rules will specify the
    capabilities of the edges in the graph. An examples of a node
    rule would be something like
    
    node DECNET_LEVEL_II_ROUTER :== includes (device DECNET_LEVEL_I,
    					      device DECNET_END_NODE)
    				    interfaces ( 1 to NO_OF_INTERFACES)
    				    	attributes ( NEXT_AREA, COST)
    		                    Routing_algorithm = Least_Cost(COST)
    			            Path_split_algorithm = SPLIT_LEAST_COST
    
    edge ETHERNET_LAN	:== 	speed 10Mb
    				
    The capabilities/rules would need to be much more complex than this
    (and better thought out!). If we have a complete set of topology rules
    we can now build a topology graph,  if the values for the rule
    variables are known.  Getting this information is the second
    major requirment for auto-topology.  We need a way of mapping device
    dependant representations of the variables to the internal format used
    in the rules described above.  For this mapping a library of
    translation functions or Access module calls will need to be built
    for each of the device types that exist on the network.  Using these
    translation routines we will be able to handle cases where the next
    hop in a DECnet WAN is a Cisco or Wellfleet router.  Both of these
    devices do not support the NICE protocols so their DECnet routing
    tables cannot be queried via NCP.  This information can only be
    viewed by SNMP queries.  Our current auto-topology techniques would
    break when we hit a devices whose routing table we could not query.
    By having the translation routines available we could tell the
    auto-topology function module that the Decnet router at address
    n.nnn is a Cisco and it would use the Cisco translation routines to
    get at the data.   
    
    Breaking up the auto-topology task into two pieces like this would
    allow us to use information stored in devices like HP's Lan Probe 
    without major engineering efforts. All that would have to be written
    is a simple translation function for the new devices.
    
    - Mike
    		
    
    
    
     the determination 
    we will be able to achieve in the next few years will be computer
    assisted topology determination.  Auto topology assumes we are able 
    to get at the critical routing/bridging tables in our networking
    devices   
1243.8auto-layout & auto-configCLARID::HOFSTEETake a RISC, buy a VAXTue Oct 08 1991 06:5141

I agree with the title of .-1. "Auto topology will never be easy".
I find this discussion very interesting since we did some work in the past
on autotopology for Ethernets and IBM networks. As most of us seem to agree,
if we talk about auto topology, we actually mean two things:

1. Auto-config : finding out in an automated manner, what is connected to
                 what, and storing that in some DB.

2. Auto-layout : Using the information in the DB, producing a graph out of
                 this data.


The first one  requires knowledge on things like: how routers work, what 
information is stored in what kind of devices (routing tables, forwarding
  DB's etc), how to get and update this information (NICE, SNMP) etc, etc.

The second one requires knowledge on topology algorithms like:
how to draw a "nice" representation of a meshed network or an Ethernet or
a token ring, How to minimize crossings , etc. etc.

Both tasks are not easy , and I agree with one of the previous noters that 
we should approach both areas in a step by step manner. 

I would suggest to keep the discussion in this note separated in these two
areas. Personally I am more interested in auto-layout. I think that a good
approach for the auto-layout problem, is as mentioned in .-1. It  is
possible to develop a syntax, that would enable you to define auto-layout
rules. The auto-layout module, would than use these rules to figure out a
"nice" looking representation of the network. Notice that I mention "nice"
between quotes, because there doesn't exist such a thing as 'one correct
presentation'. Think about how many ways you can draw a meshed network with
let's say 10 nodes!

Keep this discussion going.....

Timo

PS:Given the above split, what may we expect in V1.2 from an auto-config and
   an auto-layout point of view?