Conference napalm::commusic_v1

1945.0. "VideoHarp - Orchestra in a Box" by ORION::WIEGLER () Wed Mar 22 1989 13:03

VNS TECHNOLOGY WATCH:                           [Mike Taylor, VNS Correspondent]
=====================                           [Nashua, NH, USA               ]

              Computers You Control With a Wave of Your Hand

    Paul McAvinney has built his own orchestra from scratch, and he
    carry the whole thing over his shoulder.  Holding his glowing
    instrument, he gestures in the air like a conductor. the sounds of
    woodwinds, strings and percussion instruments spill from a synthesizer.
    He passes a hand along his VideoHarp to trigger a trumpet's blast.
    "This is a whole new class of instrument," says the  Carnegie Mellon
    University researcher.

    It is also a completely different way of manipulating computerized
    information. Sensors in the instrument detect how shadows from the
    hands alter the light beam in from a neon tube. Pump those impluses
    through a computer to a synthesizer, and you get a electronic
    music. Connect those sensors to a computer with graphic images, and
    hand movements in empty space can grasp and control images on the
    display terminal. McAvinney was inspired to design a computer
    system that would respond to hand movements because he always "wanted
    to conduct an orchestra." He called manufacturers of computer
    displays to see if they were interested. Their answer: "why would
    anyone want to do that?" Instead of giving up, McAvinney recalls,
    "I ran off to the Patent Office." He also left his job at GE to
    build a prototype of the VideoHarp.

    The harp consists of two clear plastic sheets that are joined like a
    V with a 28 inch neon tube running along the seam.  Mirrors inside
    the harp bounce the light around and reflect it to a sensor. Shadows
    from fingers passing along or just above the plastic's surface block
    some of the light, creating disturbances that are translated into
    digital signals.

    McAvinney major competition is from VPL Research. VPL has developed a
    glove covered with sensors that record the movement of the user's
    fingers and transmit the data to a computer. encased in the glove, a
    designer can "pick up" the part being designed. The glove can also
    be used to move real things by controlling a remote robot hand.

    VPL has already sold 100 of its DataGlove for $8,000 to research
    labs. The technology is also used in a $75 Power Glove developed by
    Mattel Inc. for use with Nintendo games. It will be offered next
    fall as an alternative to the joystick.

    The company is using the same technology to make a full body
    DataSuit which will simulate the wear's movements. among the
    applications targeted: computer animation and robotics. Meanwhile
    McAvinney hopes to build a VideoHarp that fills an entire stage.
    In the performance area ringed by neon, dancers will be set free to
    create their own musical accompaniment through their movements.
    {Business Week Feb 20, 1989}

    I can see it transmitting velocity info. I can see it transmitting
    MIDI clock info. But how does it know what NOTES to play??? 
                             
    ??
    
    Edd

    I saw some professor playing a spatial-gizmo on t.v. the other night.
    He cheated -- all the musical parts were already midied into the
    computer, and the spatial dynamics of his 'conducting' determined the
    mix. So he had strings N.E., woodwind E.N.E., brass S, etc.
    This thing might use that, or it might be like a hi-tech musical saw,
    a sort of hyper-expensive swannee whistle.
    
    Richard.

    Gee, good luck to this guy.  Something like that has already been
    demonstrated using a Commodore Amiga with a video camera connected
    to it.  The interesting part is done using software.

    Chong.