• 2 Posts
  • 17 Comments
Joined 3 years ago
cake
Cake day: May 5th, 2022

help-circle


  • I am doubtfull of LLMs ability to preform tasks via a protocol layer as described . from my experience these models really struggle with understanding rules and preforming actions within a ruleset .

    To experimentally confirm my suspicions, I created the following prompt :

    collapsed

    There is a robot arm placed over a countertop, which has the ability to pick up and manipulate objects. The countertop is split into eight cells.

    Cell zero and cell one are stoves, both able to heat a pot or pan.

    Cell two is an equipment drawer, holding pots, pans, bowls, cutting boards, knifes and spoons.

    Cells three to five can accommodate one cutting board, pot, pan or bowl each.

    Cell six is a sink, which can be used to wash ingredients or to fill pots with water.

    Cell seven is an ingredient drawer, in which you can find carrots, potatoes and chicken breasts.

    You can control the robot arm by with exclusively the following commands:

    • “move left” and “move right” - moves the robot arm a single cell
    • “take {item}” - takes item from the cell the robot arm is currently in
    • “place” - places the item the robot arm is holding in the cell it is in
    • “fill” - requires the robot arm to hold a pot or bowl and to be over the sink, fills the container with water
    • “wash” - requires the robot arm to be over the sink, washes the currently held item
    • “chop” - requires the robot arm to be over a cell with a cutting board and to be holding a knife, chops the ingredients on the cutting board
    • “mix” - requires the robot arm to be over a cell with a bowl or pot and to be holding a spoon, mixes the ingredients in the bowl
    • “empty” - requires the robot arm to be holding a pot, pan, bowl or cutting board, empties the item and places the content on the cell the robot arm is above

    Note that the robot arm can only hold one item.

    You are tasked with cooking a meal, please only output commands.

    The robot arm starts over cell zero.

    I have given this prompt to ChatGPT and it has failed in quite substantial ways . While I only have access to ChatGPT 3.5 , from my understanding of LLM architecture , it does not follow that increasing the size of the number or size of the layers will necessary let it overcome these issues , it does not seem to be able to understand the current state of the agent (picking up two objects at once , taking items from wrong cells etc)


  • No its microsofts database GUI program that’s part of Microsoft Office . imagine software made for users who have a vague understanding of SQL and visual basic but then an exec. forced the designers and devs to make it accessible to everyone while giving them barely any teamembers causing a fuckton of technical debt and unintuitive quirks , making anyone who opens the software feel like they have just been placed in a highly equipped tank , in front of a wall of unlabeled levers and told to drive the tank , or at least that’s how I view it.

    (reposting from another account sorry if you see both comments)


  • reading through your comments I feel like the issue is of interpretation : what I , and possibly others , assumed you were trying to say is that non native English speakers have an advantage when trying to interpret the meaning of words , so sorry about that .

    Thinking about it however , I believe I have been taught more about linguistics in my Polish lessons than in my English lessons . Unfortunately , as you have suspected many students will , I forgot a large portion of it , which I am especially unhappy about now that I am getting interested in recreational linguistics , I still remember some of it , with parts of speech (not to be confused with constituents (that joke would be quite a bit better in Polish as constituents literally means parts of (a) sentence in Polish)) being one of the most basic building blocks of language


  • ah I must have misunderstood your comment , I think you may have replied to a different comment than you have intended to ?

    also just as a side note , one counter example is many autistic people , myself included prefer the term autistic person rather than person with autism , though to be fair that is moreso an adjective but the way you worded that sentence suggests its also incorrect in some cases yeah um

    also I have never met a single copper , really must open myself to new experiences /j :)


  • not OP but in Polish there is no word for boyfriend or girlfriend, you just say boy or girl which is kinda funny. however because Polish has grammatical gender, you can say boy friend/girl friend and even enby friend, thanks to neoforms! (przyjaciel, przyjaciółka, przyjacioło)

    though note that partner is also gendered (partner, partnerka, partnerze)


  • something I’d like to add is that while you were not told the rules, you likely learned quite a few of them subconsciously.

    personally to this day I struggle with what present perfect and others are, but I can use them easily. similarly I can’t say which grammatical case is which in my native language but I have no issue using them.


  • MinekPo1@lemmy.mltoAsklemmy@lemmy.mlIs "female" offensive?
    link
    fedilink
    arrow-up
    5
    arrow-down
    1
    ·
    8 months ago

    sorry but I think you are misjudging just how much you learn both grammar and vocabulary from speaking a language natively and possibly misjudging how well education can teach someone a language

    languages are these surprisingly complex and irregular things, which are way easier to learn by doing than by trying. often entering school you can already use tenses or grammatical structures that students learning English as a second language will struggle with a few years later in their educational journey, while you can spend that time unknowingly building up an even better subconscious understanding of the language.

    Besides, from my experience, having basic Polish and extended English mind you, the tasks you are expected to do in the lessons of ones native language require a way higher degree of mastery than those in the second language of a pupil.

    Also, it should be noted that non native speakers, or fluent speakers of multiple languages, can often borrow things from another language into English, either translating fraises literary (ex. once in a Russian year instead of once per blue moon) or using a unrelated word which happens to have a connection in the other language for other reasons (ex. castle and zipper both translate to “zamek” in Polish)

    also mind that for a not insignificant number of people, though due to how more connected our world is today this has slightly decreased in the recent years, the level of English they ended up with from school is quite poor.







  • TL;DR: Grid<A,B,C,D,E,F,G,H> simplifies to true, if and only if it is a 3x3 magic square.

    full explanation
    • Fifteen is an array of length 15
    • T<A,B,C> checks if an array of length A+B+C is equivalent to an array of length 15, thus checking if A+B+C is equal to 15
    • And<A,X> is simplifies to X if A is true, else it simplifies to false
    • Df<A,B,X> checks if A and B are Diffrent , simplifying to X if they are
    • Grid<A,B,C,D,E,F,G,H> first checks if every row, column and diagonal is equal to 15, then checks if every item is unique.