sistemi di IA e scrittura
mi sono imbattuto in questo libro: Baron, Naomi S. /Who wrote this? how AI and the lure of efficiency threaten human writing/. Stanford, California: Stanford University Press, 2023. nel capitolo finale l'autrice scrive:
Imagine a world where AI’s current writing challenges have been solved. Where large language models (or their successors) don’t churn out ugliness. Where using them is energy efficient. Where predictive texting, spellcheck, and grammar programs are infallible. Where AI can produce lengthy texts that are non-repetitive, stylistically interesting, factually accurate, and always on topic. Oh, and can generate text that’s indistinguishable from what you might have written. Where would this world leave us humans? As we weigh options, keep in mind potential blowback of getting what we wish for. Cultural lore—be it of King Midas in Greek mythology, the recurrent “three wishes” stories across European tales, or W. W. Jacobs’s more modern “The Monkey’s Paw”—reminds us that attractive prospects may bear unforeseen consequences. lo trovo interessante perché molta parte della riflessione critica sui sistemi di AI si appunta su singoli aspetti mal-funzionanti/dis-funzionanti. mentre qui c'è una riflessione critica globale, 'a prescindere', che si esprime sui sistemi di IA ma che riguarda ogni ambito: è desiderabile/quali conseguenze ha, che in ogni campo ogni necessità sia risolta e ogni difficoltà operativa sia eliminata ? "teletrasporto per tutti a costo zero" e via in cima al monte Bianco con un tasto (in questo esempio si vede che sono proprio uno al pie' dei monti - piemontese): che cosa mi significherebbe?
Maurizio ------------------------------------------------------------------------ quanti nella loro vita si fecero custodi delle termopili, sono degni di più grande onore se prevedono (e molti lo prevedono) che all’ultimo comparirà un efialte e comunque i persiani passeranno kostantinos kavafis, termopili ------------------------------------------------------------------------ Maurizio Lana Università del Piemonte Orientale Dipartimento di Studi Umanistici Piazza Roma 36 - 13100 Vercelli
Grazie della segnalazione, Maurizio. Sono domande che Joseph Weizenbaum poneva, anche a proposito della comprensione del linguaggio naturale, in Computer power and human reason: The second kind of computer application that ought to be avoided, or at least not undertaken without very careful forethought, is that which can easily be seen to have irreversible and not entirely foreseeable side effects. If, in addition, such an application cannot be shown to meet a pressing human need that cannot readily be met in any other way, then it ought not to be pursued. The latter stricture follows directly from the argument I have already presented about the scarcity of human intelligence. The example I wish to cite here is that of the automatic recognition of human speech. There are now three or four major projects in the United States devoted to enabling computers to understand human speech, that is, to programming them in such a way that verbal speech directed at them can be converted into the same internal representations that would result if what had been said to them had been typed into their consoles. The problem, as can readily be seen, is very much more complicated than that of natural-language understanding as such, for in order to understand a stream of coherent speech, the language in which that speech is rendered must be understood in the first place. The solution of the "speech-understanding problem" therefore presupposes the solution of the "natural-language-understanding problem." And we have seen that, for the latter, we have only "the tiniest bit of relevant knowledge." But I am not here concerned with the technical feasibility of the task, nor with any estimate of just how little or greatly optimistic we might be about its completion. Why should we want to undertake this task at all? I have asked this question of many enthusiasts for the project. The most cheerful answer I have been able to get is that it will help physicians record their medical notes and then translate these notes into action more efficiently. Of course, anything that has any ostensible connection to medicine is automatically considered good. But here we have to remember that the problem is so enormous that only the largest possible computers will ever be able to manage it. In other words, even if the desired system were successfully designed, it would probably require a computer so large and therefore so expensive that only the largest and best-endowed hospitals could possibly afford it—but in fact the whole system might be so prohibitively expensive that even they could not afford it. The question then becomes, is this really what medicine needs most at this time? Would not the talent, not to mention the money and the resources it represents, be better spent on projects that attack more urgent and more fundamental problems of health care? But then, this alleged justification of speech-recognition "research" is merely a rationalization anyway. (I put the word "research" in quotation marks because the work I am here discussing is mere tinkering. I have no objection to serious scientists studying the psycho-physiology of human speech recognition.) If one asks such questions of the principal sponsor of this work, the Advanced Research Projects Agency (ARPA) of the United States Department of Defense, as was recently done at an open meeting, the answer given is that the Navy hopes to control its ships, and the other services their weapons, by voice commands. This project then represents, in the eyes of its chief sponsor, a long step toward a fully automated battlefield. I see no reason to advise my students to lend their talents to that aim. I have urged my students and colleagues to ask still another question about this project: Granted that a speech-recognition machine is bound to be enormously expensive, and that only governments and possibly a very few very large corporations will therefore be able to afford it, what will they use it for? What can it possibly be used for? There is no question in my mind that there is no pressing human problem that will more easily be solved because such machines exist. But such listening machines, could they be made, will make monitoring of voice communication very much easier than it now is. Perhaps the only reason that there is very little government surveillance of telephone conversations in many countries of the world is that such surveillance takes so much manpower. Each conversation on a tapped phone must eventually be listened to by a human agent. But speech-recognizing machines could delete all "uninteresting" conversations and present transcripts of only the remaining ones to their masters. I do not for a moment believe that we will achieve this capability within the future so clearly visible to Newell and Simon. But I do ask, why should a talented computer technologist lend his support to such a project? As a citizen I ask, why should my government spend approximately 2.5 million dollars a year (as it now does) on this project? https://archive.org/details/computerpowerhum0000weiz_v0i3/page/270 Un saluto, Daniela ________________________________________ Da: nexa <nexa-bounces@server-nexa.polito.it> per conto di maurizio lana <maurizio.lana@uniupo.it> Inviato: giovedì 8 febbraio 2024 16:57 A: NEXA ML Oggetto: [nexa] sistemi di IA e scrittura mi sono imbattuto in questo libro: Baron, Naomi S. Who wrote this? how AI and the lure of efficiency threaten human writing. Stanford, California: Stanford University Press, 2023. nel capitolo finale l'autrice scrive: Imagine a world where AI’s current writing challenges have been solved. Where large language models (or their successors) don’t churn out ugliness. Where using them is energy efficient. Where predictive texting, spellcheck, and grammar programs are infallible. Where AI can produce lengthy texts that are non-repetitive, stylistically interesting, factually accurate, and always on topic. Oh, and can generate text that’s indistinguishable from what you might have written. Where would this world leave us humans? As we weigh options, keep in mind potential blowback of getting what we wish for. Cultural lore—be it of King Midas in Greek mythology, the recurrent “three wishes” stories across European tales, or W. W. Jacobs’s more modern “The Monkey’s Paw”—reminds us that attractive prospects may bear unforeseen consequences. lo trovo interessante perché molta parte della riflessione critica sui sistemi di AI si appunta su singoli aspetti mal-funzionanti/dis-funzionanti. mentre qui c'è una riflessione critica globale, 'a prescindere', che si esprime sui sistemi di IA ma che riguarda ogni ambito: è desiderabile/quali conseguenze ha, che in ogni campo ogni necessità sia risolta e ogni difficoltà operativa sia eliminata ? "teletrasporto per tutti a costo zero" e via in cima al monte Bianco con un tasto (in questo esempio si vede che sono proprio uno al pie' dei monti - piemontese): che cosa mi significherebbe? Maurizio ________________________________ quanti nella loro vita si fecero custodi delle termopili, sono degni di più grande onore se prevedono (e molti lo prevedono) che all’ultimo comparirà un efialte e comunque i persiani passeranno kostantinos kavafis, termopili ________________________________ Maurizio Lana Università del Piemonte Orientale Dipartimento di Studi Umanistici Piazza Roma 36 - 13100 Vercelli
Buongiorno, Daniela Tafani <daniela.tafani@unipi.it> writes:
Grazie della segnalazione, Maurizio.
Sono domande che Joseph Weizenbaum poneva, anche a proposito della comprensione del linguaggio naturale, in Computer power and human reason:
grazie per il richiamo
The second kind of computer application that ought to be avoided, or at least not undertaken without very careful forethought, is that which can easily be seen to have irreversible and not entirely foreseeable side effects. If, in addition, such an application cannot be shown to meet a pressing human need that cannot readily be met in any other way, then it ought not to be pursued.
"met in other way", tecnicamente, significa "utilizzando altre interfacce utente"
The latter stricture follows directly from the argument I have already presented about the scarcity of human intelligence.
sarebbe interessante quindi comprendere cosa Weizenbaum intendesse con "scarcity of human intelligence"
The example I wish to cite here is that of the automatic recognition of human speech. There are now three or four major projects in the United States devoted to enabling computers to understand human speech, that is, to programming them in such a way that verbal speech directed at them can be converted into the same internal representations that would result if what had been said to them had been typed into their consoles.
attenzione che Weizenbaum si riferisce chiaramente al processo di *comprensione* di quanto espresso col linguaggio naturale, NON al riconoscimento automatico delle parole pronunciate, che è del tutto analogo al riconoscimento OCR di un documento scansionato (o fotografato) con l'ultimo passo "(as) if that whould had beeb said to them had been typed" è /implicito/ che si stia riferendo alla User Interface (e *quindi* alla sua progettazione) [...]
The solution of the "speech-understanding problem" therefore presupposes the solution of the "natural-language-understanding problem." And we have seen that, for the latter, we have only "the tiniest bit of relevant knowledge."
e la stessa cosa vale oggi, non solo all'epoca di pubblicazione di quel libro [...]
Why should we want to undertake this task at all?
questa è LA domanda: perché?
I have asked this question of many enthusiasts for the project. The most cheerful answer I have been able to get is that it will help physicians record their medical notes and then translate these notes into action more efficiently.
ma chi lo ha detto che il modo più EFFICIENTE di scrivere un referto medico è quello di "dettarlo e farlo trascrivere al computer"?!? il dittafono esiste dalla fine del XIX secolo e serve affiché UN ALTRO AGENTE trascriva il testo dettato al posto della persona che non è capace di scriverselo da solo; fino a un certo punto c'erano solo le segretarie, di "recente" sono state affiancate da "software di trascrizione" [1] ...ma la questione relativa all'EFFICIENZA del "sistema di trascrizione" rimane la stessa identica di più di un secolo fa: chi trascrive DEVE sapere svolgere una attività INTELLIGENTE (deve conoscere il campi di applicazione nel quale agisce), altrimenti il risultato è DEFICIENTE. quindi: non è più efficiente quel medico in grado di usare direttamente lo strumento a disposizione per trascrivere quello che ha in testa?!? dal punto di vista pedagogico-cognitivo, poi, attenzione a cascare nella trappola che strumenti e/o interfacce FACILI sono preferibili perché aiutano gli utenti a svolgere i compiti "meglio" (mi viene in mente l'esempio della calligrafia ma lasciamo perdere) [...]
Would not the talent, not to mention the money and the resources it represents, be better spent on projects that attack more urgent and more fundamental problems of health care?
tipo progettare meglio il sistema di trascrizione e archiviazione dei referti medici?
But then, this alleged justification of speech-recognition "research" is merely a rationalization anyway.
volgarmente: trovare un (non) problema adatto a giustificare una soluzione inutile [...]
the answer given is that the Navy hopes to control its ships, and the other services their weapons, by voice commands.
perché? I piloti sono meno efficienti se usano il timone o la cloche?!? :-O «Alexa, gira a destra...» dunque abbiamo: medici che non sanno usare efficacemente la tastiera come interfaccia al proprio strumento di registrazione dei referti e piloti che non sanno usare efficacemente il timone? [...]
what will they use it for? What can it possibly be used for? There is no question in my mind that there is no pressing human problem that will more easily be solved because such machines exist.
solo per far credere alle persone che è inutile che loro imparino ad usare interfacce più adeguate per interagire con i computer (e i dispositivi "computer aided")
But such listening machines, could they be made, will make monitoring of voice communication very much easier than it now is. Perhaps the only reason that there is very little government surveillance of telephone conversations in many countries of the world is that such surveillance takes so much manpower.
esatto: nel frattempo hanno "risolto" il problema archiviando quantità ASTRONOMICHE di conversazioni registrate nella speranza di trovare "un computer" che prima o poi le trascriva tutte e le dia in pasto alle loro search engines AI powered per scovare i terroristi ancora prima che terrorizzino
Each conversation on a tapped phone must eventually be listened to by a human agent. But speech-recognizing machines could delete all "uninteresting" conversations and present transcripts of only the remaining ones to their masters. I do not for a moment believe that we will achieve this capability within the future so clearly visible to Newell and Simon.
previsione sbagliata
But I do ask, why should a talented computer technologist lend his support to such a project? As a citizen I ask, why should my government spend approximately 2.5 million dollars a year (as it now does) on this project?
[CLASSIFIED] [...] saluti, 380° [1] https://en.wikipedia.org/wiki/Transcription_(linguistics)#Software -- 380° (Giovanni Biscuolo public alter ego) «Noi, incompetenti come siamo, non abbiamo alcun titolo per suggerire alcunché» Disinformation flourishes because many people care deeply about injustice but very few check the facts. Ask me about <https://stallmansupport.org>.
Buonasera, Il 10/02/2024 13:51, 380° ha scritto:
sarebbe interessante quindi comprendere cosa Weizenbaum intendesse con "scarcity of human intelligence"
Si riferiva a questa considerazione: Surely finely honed human intelligence is among the scarcest of resources available to modern society. And clearly some problems amenable to scientific investigation are more important than others. Human society is therefore inevitably faced with the task of wisely distributing the scarce resource that is its scientific talent. There simply is a responsibility—it cannot be wished away—to decide which problems are more important or interesting or whatever than others. Every specific society must constantly find ways to meet that responsibility. The question here is how, in an open society, these ways are to be found; are they to be dictated by, say, the military establishment, or are they to be open to debate among citizens and scientists? If they are to be debated, then why are ethics to be excluded from the discussion? And, finally, how can anything sensible emerge unless all first agree that, contrary to what John von Neuman asserted, technological possibilities are not irresistible to man? "Can" does not imply "ought." Unfortunately, the new conformism that permits us to speak of everything except the few simple truths that are written in our hearts and in the holy books of each of man's many religions renders all arguments based on these truths—no matter how well thought out or eloquently constructed—laughable in the eyes of the scientists and technicians to whom they may be addressed. This in itself is probably the most tragic example of how an idea, badly used, turns into its own opposite. Scientists who continue to prattle on about "knowledge for its own sake" in order to exploit that slogan for their self-serving ends have detached science and knowledge from any contact with the real world. A central question of knowedge, once won, is its validation; but what we now see in almost all fields, especially in the branches of computer science we have been discussing, is that the validation of scientific knowledge has been reduced to the display of technological wonders. This can be interpreted in one of only two ways: either the nature to which science is attached consists entirely of raw material to be molded and manipulated as an object; or the knowledge that science has purchased for man is entirely irrelevant to man himself. Science cannot agree that the latter is true, for if it were, science would lose its license to practice. That loss would, of course, entail practical consequence (involving money and all that) which scientists would resist with all their might. If the former is true, then man himself has become an object. There is abundant evidence that this is, in fact, what has happened. But then knowledge too has lost the purity of which scientists boast so much; it has then become an enterprise no more or less important and no more inherently significant than, say, the knowledge of how to lay out an automobile assembly line. Who would want to know that "for its own sake"? Un saluto, Daniela
participants (3)
-
380° -
Daniela Tafani -
maurizio lana