• 1 Post
  • 3 Comments
Joined 3 years ago
cake
Cake day: February 1st, 2023

help-circle

  • edinbruh@feddit.ittoMemes@sopuli.xyzOpenAI be like
    link
    fedilink
    English
    arrow-up
    7
    ·
    edit-2
    3 days ago

    In this context “weight” is a mathematical term. Have you ever heard the term “weighted average”? Basically it means calculating an average where some elements are more “influent/important” than others, the number that indicates the importance of an element is called a weight.

    One oversimplification of how any neural network work could be this:

    • The NN receives some values in input
    • The NN calculates many weighted averages from those values. Each average uses a different list of weights.
    • The NN does a simple special operation on each average. It’s not important what the operation actually is, but it must be there. Without this, every NN would be a single layer. It can be anything except sums and multiplications
    • The modified averages are the input values for the next layer.
    • Each layer has different lists of weights.
    • In reality this is all done using some mathematical and computational tricks, but the basic idea is the same.

    Training an AI means finding the weights that give the best results, and thus, for an AI to be open-source, we need both the weights and the training code that generated them.

    Personally, I feel that we should also have the original training data itself to call it open source, not just weights and code.


  • I would like to interject for a moment. This statement is technically true but disingenuous and facetious.

    While it’s true that Linux is just the kernel, what most people refer to as Linux is actually the Operating System GNU/Linux, or, as RMS would now call it, GNU plus Linux, or sometimes, a less GNU depended, but mostly GNU/Linux compatible OS, or, as I have literally just now come to call it */Linux.

    Moreover, a modern */Linux system is expected to be based on SystemD, unless explicitly avoiding it due to some technical constraint or some desired feature of another init system. One could come to call this SystemD/Linux.

    And lastly, this kind of use case would be the perfect match for a Wayland shell, as opposed to an X11 shell. Which would be more efficient, and would give the shell more freedom in the management of windows.

    As a result, when asking about a Linux phone, we could expect one is talking about a phone running a SystemD+Wayland/Linux OS, or at least a mobile-focused */Linux OS.

    The Android kernel is a, largely downstream, fork of the Linux kernel, but the Android OS is in almost no way compatible with any */Linux OS, and it’s instead its own completely different OS.