From: rick@cs.arizona.edu (Rick Schlichting) Subject: INDUSTRY: MITI Plan for Image Laboratory in Kansai (LONG) Date: 18 Feb 92 03:39:11 GMT Crossposted from comp.research.japan. [Dr. David Kahaner is a numerical analyst on sabbatical to the Office of Naval Research-Asia (ONR Asia) in Tokyo from NIST. The following is the professional opinion of David Kahaner and in no way has the blessing of the US Government or any agency of it. All information is dated and of limited life time. This disclaimer should be noted on ANY attribution.] [Copies of previous reports written by Kahaner can be obtained from host cs.arizona.edu using anonymous FTP.] From: David K. Kahaner, ONR Asia [kahaner@cs.titech.ac.jp] Re: MITI Plan for Image Laboratory in Kansai 20 Feb 1992 This file is named "image.lab" ABSTRACT. MITI's plans for the establishment of an Image Laboratory in the Kansai area of Japan are detailed. INTRODUCTION AND SUMMARY. My interest in "imaging" was rekindled by participation in the recent 3D imaging symposium (see report, 3d-2-92, Feb 1992). At the same time I came upon a description by M.Soraku of MITI (Ministry of International Trade and Industry), Information Systems Development Division, of plans based on studies since 1987, for the establishment of a laboratory in the Kansai area (between Kyoto and Osaka) for research and development of image technology in a very broad sense. The text below is a translation of Soraku's original Japanese paper. In short it describes the plans to establish a laboratory in which computing science research in image recognition, AI, visual agents, human/computer interface, 3-D vision, holographic storage, databases, etc., is combined with applications that overlap design, art, as well as numerical simulation and visualization. The underlying philosophy is that previous research has been focused on logical processing leading to AI, image processing, image recognition, etc., but that humans think in terms of images, physical thoughts, and emotional information--the latter areas will be the research fields of the new Image Lab. The lab will have a heavy emphasis on training of researchers and students, international technology transfer, and popularization of the technology outside of the narrow engineer/scientist community. MITI feels that a large number of sciences can make use of the output research. Their list includes (in no particular order), Cultural and anthropological fields Art and design Linguistics Psychology Control engineering Communication engineering Information engineering Sensibility engineering (I don't know what this is) Electrical and electronic engineering Mechanical engineering Chemical engineering Instrumentation engineering Physiology Biological engineering Two specific research themes are to be the following. (1) "Human Communication Research Based on Imagery Science" (2) "Research on Synthesized Sensibility Information Processing of Images, Space, Music, and Dynamic Images" As further details of budgets, time schedules, etc., become available I will describe them in more detail. ------------------------------------------------------------------------ By M. Soraku, Machinery and Information Industries Bureau, Information Systems Development Division, Ministry of International Trade and Industry. I. OBJECTIVES OF ESTABLISHMENT OF LABORATORY. "Images" are thought forms derived from a synthesis of human sensibilities, skills, experiences, knowledge, etc. Images play an exceedingly important role in man' s creative activities: imagination, intuition, and ideas. Since it has not previously been possible to directly reduce externally expressive forms of imagery (skills, form, art, performance, etc .) into physical and informational quantities, these areas were considered to be the domain of specific skilled persons, artists, and professionals. Consequently, transmission and industrial applications were considered to be difficult. In recent years however, due to the development of information technology and interdisciplinary findings concerning the mechanism of the action of images, the possibility of image information processing is beginning to take shape. More precisely, in addition to the progress taking place in the development of basic technology, hardware, and software relating to image recognition processing, artificial intelligence, human interfacing, databases for sensible information, three-dimensional visual presentations, etc., progress is also being made in interdisciplinary approaches with regard to the mechanism of the action of images, from the psychological, biological, and informational engineering aspects. Meanwhile, in the area of social needs, strong demands are being made for the development and creation of more civilized products and environments which possess greater affinity with mankind and nature. In industry, the need is growing for the promotion and development of technology, design and production systems, architecture, town planning, and environmental engineering technology in answer to these social demands. Also, the training and acquisition of technical personnel and designers in these fields and the establishment of bases for the promotion of the industry have become matters requiring urgent attention. >From a macroscopic viewpoint, in order to pursue the mutual understanding of international cultures, the promotion of the arts, interpersonal contacts, the cultivation of richer minds, etc., and to achieve a more abundant information society, it will be necessary to process as information the sensibilities, skills, creativity, innovations, etc., which we are prone to accumulate within ourselves, and widely apply them to industry, the economy, the arts, culture, and the lives of people. While the fundamentals (development, application research, and promotion) of industrial technology concerning information technology relating to such imagery possessed by humans are becoming increasingly important at a time when "latitude and abundance" are being sought, these matters are not being adequately dealt with. There are limits to what industry can accomplish alone, because of the close collaboration between the technological aspects of this field and other fields, such as the arts and sciences. Concerted promotional efforts by industry, academia, government, and other circles are necessary. In light of such a situation, in which the fundamental work of information technology relating to imagery, related development, forceful R&D on application research, and the establishment of technological promotional bases are being strongly called for, studies on the desired configuration of laboratories have continued since March 1987, with the cooperation of industry, academia, and the government. Based on the results of these studies, the establishment of a foundation tentatively called the "Image Laboratory" has recently been planned for the Kansai district. This area abounds in industrial and academic researchers and fields of application pertaining to the subject. This laboratory will conduct interdisciplinary R&D work on artificial sensibilities, artificial skills, and other image-related information processing technology. In addition, the laboratory will fortify the foundations of information processing, so as to contribute to the upgrading of industry and the enhancement of the livelihood of the people. The business activities of the foundation are introduced below. II. FUNCTIONS OF LABORATORY Centered around image-related R&D work, the activities of the laboratory will be developed to include the training of researchers, interchange work, supporting image processing and production work (image factory), surveys, popularization and promotional activities, etc. The laboratory is intended to be freely accessible to both local and foreign nationals. (1) R&D Work 1) Research activities Basic research work, application research, development of image technology, basic software development, etc., centered around sensible information processing and visual information processing fields, will be carried out under the concerted efforts of local and foreign industrial, governmental, and academic researchers. 2) Research forum In addition to providing a research forum to enable scholars in such different fields as engineering, the arts, and cultural subjects, to conduct mutually enlightening and creative research work which hurdle interdisciplinary walls, the seeds of futuristic R&D work will be nurtured. (2) Image Factory (Studio) Work Image creation work such as image information processing and storage work which become necessary in the course of conducting R&D activities at the laboratory, simulation work, processing of images received from outside sources, process analyses, production, etc., will be carried out utilizing state-of-the-art software and hardware. (3) Training of Researchers--ORT (on-the-research training) 1) Each research group will take in researchers from private industry, universities, etc., and on-the-research training will be conducted under the guidance of research leaders. Private industry will be able to carry out the systematic training of its researchers by sending suitable personnel after evaluating the research themes, methods, and leaders. 2) Students, trainees, and professors from other countries will be actively accepted and researcher training and international technology transfers carried out. 3) Technology transfers and mutual improvement will be actively pursued by means of interpersonal exchanges between personnel from the laboratory proper, universities, and private industry, etc. (4) Surveys, Popularization, and Promotional Work 1) Survey, popularization work In addition to conducting surveys on the trends of related technologies in order to stimulate R&D, research popularization activities will be carried out. These will include the convening of conferences and seminars, publicizing of research, preparing networks, controlling R&D, technology transfers, etc. 2) Research implementation With regard to themes for dealing with specific needs such as the implementation of development and application type basic research, projects will be done by cooperating with local public bodies, public funding, international grants, etc. III. RESEARCH AND DEVELOPMENT Human thought consists of three elements: physical thoughts, imagery (mental or intuitive), and logic. In terms of human growth stages, physical thoughts germinate first. Next comes imagery, followed by the gradual development of logic, which are believed to eventually constitute the upper structure. Looking at these elements of human thought from the standpoint of information processing, while logical thoughts can now be supported to a considerable extent by means of computers, information processing with regard to imagery and physical thoughts is considered to have just started. The image laboratory will attempt to process as information these elements of thought that have been difficult to verbalize or symbolize up to now, including visual, auditory, sensibility and emotional information. IV. R&D THEMES TO BE CURRENTLY PURSUED For the time being, R&D will involve the artificial simulation of image information and the establishment of four basic research themes to enable the coupling of these to creativity, performance, human communication, etc. These tasks will be performed interactively by means of the multiclient systems of private industry. Research Theme 1 "Human Communication Research Based on Imagery Science" (1) Research Objectives The focus will be the analysis, expression, processing, and formative procedures of external expressions, actions, and behavior of "people, " the main subjects of communication. Also, by further pursuing human-like sensibilities and autonomy by a fusion of computer vision and computer graphics technologies, it is intended to create a realistic intellectual agent that can communicate with humans through the world of imagery. (2) Anticipated Results 1) Through real-time recognition of facial and external expression and the construction of formative technologies, actual utilization can be made with regard to intellectual communications, medical diagnoses, etc. 2) Soft three-dimensional models and sophisticated texture mapping technology will be applied to the production, publishing, and architectural fields. 3) Human action analyses will be used in psychology, sports analyses, user interest analyses, etc. 4) Visual agents will have wide-ranging influence covering such areas as the image-related fields, services, entertainment, etc., and the advent of interfaces friendly to humans resulting from imagery science will expand man's dreams toward an abundant information society. Research Theme 2 "Research on Synthesized Sensibility Information Processing of Images, Space, Music, and Dynamic Images" (1) Research Objectives The focus will be drawings, illustrations, sculptures, carvings, musical performances, and dances. A system comprising an integration of automatic comprehension by computer of the sensible presentation of these, together with their friendly, interactive formations, and sensible information processing which will make it possible to automatically translate the sensibilities in between these images, will be formed. It is planned to study the inter relationships between the images which have actualized in the imaginary spaces and those which are inherent in the persons who originated them. (2) Anticipated Results 1) In the industrial design field, the incongruity associated with models, graphic continuity, etc., and quasi-image transmission by gestures, etc., will be eliminated, thus facilitating the development of superior design products. 2) In the educational field, the common bonding of education and concepts by the actualization of concepts and motifs by means of real-time methods will be greatly facilitated. 3) In the field of psychology, it will be possible to more accurately analyze the relationships between mental states and the senses of sight, hearing, and space. 4) By handling three-dimensional and active expressions, their free and dynamic expression will become possible, giving birth to new art forms such as computer sculpting, computer ballet, computer improvisation, etc., which will differ in quality from those existing up to now. Research Theme 3 "Research in Artificial Proficiency System" (1) Research Objectives Transfer, retention, recreation of individual talents which have traditionally been hard to express and applications by using computer graphics technology. (2) Anticipated Results 1) Possibility of incorporating highly artistic sense in industrial, architectural, and interior design. 2) Cost reduction by eliminating creation of clay models or highly inconvenient shaping process. 3) Impact on medical field as well as traditional art and preservation of art work. 4) Opportunities for skilled workers and designers. 5) Impact on educational, theatrical, and amusement fields. 6) Development of a new communications society through the sharing of information that was gained only through personal experience. Research Theme 4 "Research on Hyper Image Media" (1) Research Objectives To study the relationship between the space images and images within the human mind paying attention to holographic storage and reconstruction methods. (2) Anticipated Results 1) Possibility of incorporating highly artistic sense in industrial, architectural, and interior design. 2) Cost reduction by eliminating creation of clay models or highly inconvenient shaping process. 3) Traditionally expert system was used to adapt experts' logical thought, however the current research is aimed at opening the door to expert systems which emphasizes skills and feelings of skilled workers and designers. 4) If people relate to one another in a hypothetical space, then it will greatly effect education, theatre, and amusement fields. It will also improve the efficiency of group work. Development of a new communications society through the sharing of information that was gained only through personal experience. V. RESEARCH FORUM At a time when science and technology is becoming increasingly sophisticated and specialization is proceeding at a rapid pace, the communication gap between engineers, engineers and laymen, and engineers and artists, is increasing. In order to promote the popularization of science and technology, the fusing of the sensations of everyday life and artistic intuitions, the stimulation of mutual interchange and creativity among engineers, etc., research forums comprising experts and scholars from industrial, academic, and governmental circles will be established to discover and cultivate futuristic R&D themes, steer R&D efforts, etc., thus providing suggestions for the promotion of image information sciences and technologies. (Activities) . Convene forums, offer suggestions . Issue research bulletins . Provide research video library services . Establish researcher matching services VI. IMAGE FACTORY (STUDIO) The objectives of the Image Factory activities will be the development of image formation technology and recognition of potential needs. The forms of usage indicated below will constitute the basis of the activities. The Image Factory will be staffed fulltime to assist users, manage facilities, etc. (1) Functions 1) Services relating to visual presentation of data. Numerical data generated in the analyses of vibration, fluids, etc., will be presented in visual form by means of computer graphics (CG) technology. 2) Simulation support. Based on design data, simulations of the as-built configurations of architectural objects, mechanical parts, etc., will be performed, together with the related visual support. 3) Support AV production work. Assistance will be provided in such audiovisual (AV) production work as visual presentations, design simulations, etc., intended for industrial promotion purposes. 4) Technical consultations. Equipment will be introduced and consultative services provided in their utilization for enterprises newly adopting CG equipment and organizations (enterprises, schools) concerned with CG work. 5) Accumulation of visual data. (2) Forms of Use 1) Use of equipment for internal research themes. In relation to the nature of the research themes of the image laboratory, image formation work will be done in the Image Factory. 2) Use of equipment by supporting members and companies. The equipment will be available for use by supporting members and companies for the purposes of image formation, software evaluation, etc. 3) Use of equipment for production purposes. Assistance in data and image production will be furnished in response to requests received from public organizations and private enterprises and groups. 4) Use of equipment by ordinary users. The equipment and systems will be made freely available if the purport of the activities of the Image Factory are complied with. VII. TRAINING OF RESEARCHERS The training of image information processing researchers and engineers is a big issue of enterprises. In addition to training researchers dispatched to the foundation by enterprises participating in research work to be first-class researchers through research activities, the training of personnel as specialists for the visual era in the fields of image processing, visual presentation, simulation visualization, etc., will be undertaken in cooperation with local and foreign universities. (Main activities) (1) Acceptance and training of researchers. Researchers from private enterprises, universities, and public research institutes will be accepted for "on-the-research" training in the R&D to be done at the foundation. These researchers will be trained to become first class researchers while engaged in activities for specific periods with research leaders at the foundation. (2) Acceptance and training of foreign researchers, and others. Overseas students, trainees, and professors will be actively accepted. In addition to training such persons to be researchers of international caliber, technological interchanges will also be conducted. (3) Technological lectures, seminars. Technological lectures on such simulation and visualization areas as simulation technology, computer graphics, image processing, etc., technological lectures on scientific and artistic presentation visualizations, seminars convened in collaboration with overseas and local experts, etc., will be provided for the training of personnel. Lectures on simulation technology, computer graphics. Lectures on visual presentation design, image databases, etc. Seminars on image inspection application technology, etc. (4) Development and popularization of educational materials and equipment relating to visual technology. Visual educational materials, programs, etc., developed in the course of training image information engineers will be made available to enterprises, schools, and other related organizations. VIII. INVESTIGATIONS, POPULARIZATION, PROMOTION Work commissioned by government and public agencies, collaborative investigations with private organizations, etc., in connection with, human psychological expression technology, imaginary space technology, and industrial usage trends, the application of image information processing in the fusing of the arts, science and technology, or in cultural aspects, will be undertaken. Also, in addition to the dissemination of research results, data for promoting the application of such results will be gathered and made available. Popularization work will be actively carried out to promote industries based on image information processing technology. (Principal activities) (1) Collaborative investigations with industrial, academic, and governmental organizations, furnishing of results. Investigations relating to such image information processing and leading edge technologies as the fusion of visualization and sound of nonverbal expressions and presentations, visualization of data, visual measurement technology, artificial realism, and remote attendance systems, will be conducted in collaboration with industrial, academic, and government organizations. A fusion of the arts and science and technology will be attempted and investigations conducted on the industrial applications of image information and for expediting the promotion of science and technology. In making the results and reports concerning these investigations available at all times to the parties concerned, they will be published where necessary. (2) Popularization of Investigations. image information technology, etc. In addition to convening symposiums and report meetings concerning the results of various investigations relating to image information technology, international conferences, seminars, lectures, and the like will be held to popularize this field of technology. Convening meetings to report the results of research. Convening and supporting image-related symposiums. Convening international conferences on new interdisciplinary and interperformance fusions of the arts, and science and technology. Convening seminars, symposiums, lectures, and the like, relating to image science and technology. (3) Research project making. Projects will be implemented comprising international collaborative research relating to image science and technology, research based on cooperation between industrial and academic organizations to meet the needs of industry, etc. ----------------------------END OF REPORT-----------------------------