char-fork/llama.cpp

git clone https://git.t4t.associates/char-fork/llama.cpp

Georgi Gerganovreadme : refresh (#26280)6b36c2305

char/aliceai-t5-moe
brancheschar/aliceai-t5-moeall refs →
1012 B31 linesraw

XCFramework

The XCFramework is a precompiled version of the library for iOS, visionOS, tvOS, and macOS. It can be used in Swift projects without the need to compile the library from source. For example:

// swift-tools-version: 5.10
// The swift-tools-version declares the minimum version of Swift required to build this package.

import PackageDescription

let package = Package(
    name: "MyLlamaPackage",
    targets: [
        .executableTarget(
            name: "MyLlamaPackage",
            dependencies: [
                "LlamaFramework"
            ]),
        .binaryTarget(
            name: "LlamaFramework",
            url: "https://github.com/ggml-org/llama.cpp/releases/download/b5046/llama-b5046-xcframework.zip",
            checksum: "c19be78b5f00d8d29a25da41042cb7afa094cbf6280a225abe614b03b20029ab"
        )
    ]
)

The above example is using an intermediate build b5046 of the library. This can be modified to use a different version by changing the URL and checksum.

1# XCFramework
2
3The XCFramework is a precompiled version of the library for iOS, visionOS, tvOS,
4and macOS. It can be used in Swift projects without the need to compile the
5library from source. For example:
6
7```swift
8// swift-tools-version: 5.10
9// The swift-tools-version declares the minimum version of Swift required to build this package.
10
11import PackageDescription
12
13let package = Package(
14    name: "MyLlamaPackage",
15    targets: [
16        .executableTarget(
17            name: "MyLlamaPackage",
18            dependencies: [
19                "LlamaFramework"
20            ]),
21        .binaryTarget(
22            name: "LlamaFramework",
23            url: "https://github.com/ggml-org/llama.cpp/releases/download/b5046/llama-b5046-xcframework.zip",
24            checksum: "c19be78b5f00d8d29a25da41042cb7afa094cbf6280a225abe614b03b20029ab"
25        )
26    ]
27)
28```
29
30The above example is using an intermediate build `b5046` of the library. This can be modified
31to use a different version by changing the URL and checksum.