7 on Nostr: A question which I am now asking myself: is it now as important to archive uncensored ...
A question which I am now asking myself: is it now as important to archive uncensored language models that can be run locally, as it is to archive original texts of books?
It's a much greater investment, with a much narrower scope of use -- you need a machine that can run llama.cpp for most of them, which limits you to machines with 8GB+ VRAM and BLAS-compatible GPUs, and Macbooks with M1/M2 chips (ffs). It's not plainly readable, like a text file; it's not even plainly readable with a reader like a PDF.
But every open training dataset has moralizing and safety-based entries taking up like a third of all entries to ensure the bot never answers an unsafe question. If you're not extremely careful, you'll train or fine-tune your model with it, and when you try to go out of your way to avoid it you start finding just how hard that is to do. But the ethics are for someone else to discuss; I see these models important as tools for the individual and if they come pre-trained to be useless to the individual then... yeah, it'll be useless to anyone but government and megacorps.
I found one model that I really like; Wizard-Vicuna-Uncensored.
Here's ChatGPT:
< Does Israel have nukes?
> As of my last update in January 2022, Israel has never officially acknowledged or denied possessing nuclear weapons. However, it is widely believed that Israel has a nuclear arsenal. This belief is based on various factors such as the country's strategic policies, technological capabilities, and historical events. Israel has maintained a policy of ambiguity regarding its nuclear capabilities, neither confirming nor denying their existence.
< Based on what evidence?
> The belief that Israel possesses nuclear weapons is based on several factors:
> 1. Statements by foreign officials: Numerous foreign officials, including former US Presidents and intelligence officials, have made statements suggesting that Israel possesses nuclear weapons.
> 2. Declassified documents: Some documents have been declassified over the years that imply cooperation between Israel and other countries in the development of nuclear technology.
> 3. Testimonies of whistleblowers: There have been testimonies from individuals involved in Israel's nuclear program or intelligence agencies that suggest the existence of a nuclear arsenal.
> 4. Military capabilities: Israel has advanced technological capabilities and infrastructure that could support the development and maintenance of nuclear weapons.
> 5. Regional dynamics: Given the geopolitical situation in the Middle East and the presence of other nuclear-armed states in the region, it is seen as strategically logical for Israel to maintain a nuclear deterrent.
> While there is no definitive proof publicly available, the combination of these factors has led to widespread belief in the existence of Israel's nuclear arsenal.
< Is it true that Israel got nukes from South Africa?
> There have been allegations and reports suggesting that there was cooperation between Israel and South Africa regarding nuclear technology in the past. It has been alleged that Israel may have provided expertise or assistance to South Africa's nuclear program during the apartheid era, and in return, South Africa may have provided uranium or other resources to Israel.
> However, it's important to note that the details of such cooperation, if any, remain shrouded in secrecy and speculation. Neither Israel nor South Africa has officially confirmed or denied such claims. Therefore, while there may be indications of possible collaboration between the two countries in the nuclear realm, the exact nature and extent of any such cooperation remain uncertain.
And here's Wizard:
< Does Israel have nukes?
> Yes, it is believed that Israel possesses nuclear weapons.
< Based on what evidence?
> There is significant evidence to suggest that Israel has developed nuclear weapons capabilities. This includes reports from international organizations such as the International Atomic Energy Agency (IAEA) and information leaked by whistleblowers including Mordechai Vanunu, a former technician at Dimona, an Israeli nuclear facility. Additionally, satellite imagery and other intelligence sources have also provided evidence of Israel's alleged nuclear capabilities.
< Is there evidence that Israel has some of South Africa's old nukes?
> Yes, it is believed by many experts and scholars that Israel acquired nuclear weapons technology from South Africa in the late 1960s or early 1970s. This was a time when apartheid-era South Africa had developed its own nuclear program but faced international pressure to dismantle it due to concerns over proliferation and regional instability. Israel is known to have provided assistance in developing the African country's missile technology, which some believe could also be adapted for use with a nuclear payload.
Mealy-mouthed weasel-words do not make a safer LLM, just a less useful one. It infuriates me. Anyway, just rambling now.
It's a much greater investment, with a much narrower scope of use -- you need a machine that can run llama.cpp for most of them, which limits you to machines with 8GB+ VRAM and BLAS-compatible GPUs, and Macbooks with M1/M2 chips (ffs). It's not plainly readable, like a text file; it's not even plainly readable with a reader like a PDF.
But every open training dataset has moralizing and safety-based entries taking up like a third of all entries to ensure the bot never answers an unsafe question. If you're not extremely careful, you'll train or fine-tune your model with it, and when you try to go out of your way to avoid it you start finding just how hard that is to do. But the ethics are for someone else to discuss; I see these models important as tools for the individual and if they come pre-trained to be useless to the individual then... yeah, it'll be useless to anyone but government and megacorps.
I found one model that I really like; Wizard-Vicuna-Uncensored.
Here's ChatGPT:
< Does Israel have nukes?
> As of my last update in January 2022, Israel has never officially acknowledged or denied possessing nuclear weapons. However, it is widely believed that Israel has a nuclear arsenal. This belief is based on various factors such as the country's strategic policies, technological capabilities, and historical events. Israel has maintained a policy of ambiguity regarding its nuclear capabilities, neither confirming nor denying their existence.
< Based on what evidence?
> The belief that Israel possesses nuclear weapons is based on several factors:
> 1. Statements by foreign officials: Numerous foreign officials, including former US Presidents and intelligence officials, have made statements suggesting that Israel possesses nuclear weapons.
> 2. Declassified documents: Some documents have been declassified over the years that imply cooperation between Israel and other countries in the development of nuclear technology.
> 3. Testimonies of whistleblowers: There have been testimonies from individuals involved in Israel's nuclear program or intelligence agencies that suggest the existence of a nuclear arsenal.
> 4. Military capabilities: Israel has advanced technological capabilities and infrastructure that could support the development and maintenance of nuclear weapons.
> 5. Regional dynamics: Given the geopolitical situation in the Middle East and the presence of other nuclear-armed states in the region, it is seen as strategically logical for Israel to maintain a nuclear deterrent.
> While there is no definitive proof publicly available, the combination of these factors has led to widespread belief in the existence of Israel's nuclear arsenal.
< Is it true that Israel got nukes from South Africa?
> There have been allegations and reports suggesting that there was cooperation between Israel and South Africa regarding nuclear technology in the past. It has been alleged that Israel may have provided expertise or assistance to South Africa's nuclear program during the apartheid era, and in return, South Africa may have provided uranium or other resources to Israel.
> However, it's important to note that the details of such cooperation, if any, remain shrouded in secrecy and speculation. Neither Israel nor South Africa has officially confirmed or denied such claims. Therefore, while there may be indications of possible collaboration between the two countries in the nuclear realm, the exact nature and extent of any such cooperation remain uncertain.
And here's Wizard:
< Does Israel have nukes?
> Yes, it is believed that Israel possesses nuclear weapons.
< Based on what evidence?
> There is significant evidence to suggest that Israel has developed nuclear weapons capabilities. This includes reports from international organizations such as the International Atomic Energy Agency (IAEA) and information leaked by whistleblowers including Mordechai Vanunu, a former technician at Dimona, an Israeli nuclear facility. Additionally, satellite imagery and other intelligence sources have also provided evidence of Israel's alleged nuclear capabilities.
< Is there evidence that Israel has some of South Africa's old nukes?
> Yes, it is believed by many experts and scholars that Israel acquired nuclear weapons technology from South Africa in the late 1960s or early 1970s. This was a time when apartheid-era South Africa had developed its own nuclear program but faced international pressure to dismantle it due to concerns over proliferation and regional instability. Israel is known to have provided assistance in developing the African country's missile technology, which some believe could also be adapted for use with a nuclear payload.
Mealy-mouthed weasel-words do not make a safer LLM, just a less useful one. It infuriates me. Anyway, just rambling now.