Figures
Abstract
Faced with the challenge of increasing energy consumption and the need for sustainability in 6th generation (6G) wireless communication networks, this paper investigates the secrecy energy efficiency (SEE) and user fairness performance in an intelligent reflecting surface (IRS)-assisted non-orthogonal multiple access (NOMA) system in the presence of a friendly jammer and a passive eavesdropper over THz-Rician channels. We formulate both optimization objectives: maximizing the system’s total SEE and maximizing the maximum-min SEE to guarantee fairness for the worst-case user. Additionally, Jain’s fairness index is used to quantitatively evaluate the SEE balance among users. To solve these problems, we apply a Double Deep Q-Network (Double DQN)-based SEE of our proposed system model to jointly optimize power allocation and IRS phase shifts. This proposed approach enables efficient learning of optimal policies in dynamic environments without requiring explicit knowledge of the channel distribution. Furthermore, conventional Deep Q-Netowrk (DQN) and random allocation strategies are also implemented for comparison with Double DQN. Simulation results are presented for both IRS-assisted NOMA and OMA (orthogonal multiple access) systems to highlight the advantages of NOMA in terms of the secrecy-energy trade-off and spectral efficiency. Finally, the effects of system essential parameters, such as transmitted power, the number of IRS elements, atmospheric absorption coefficients, and the passive eavesdropper’s position, are examined. These simulation results show that the proposed Double DQN-based scheme significantly outperforms DQN and random methods in both SEE maximization and fairness enhancement, and that the NOMA system outperforms the OMA system. These findings confirm that the proposed model provides a basis for deploying a secure, energy-efficient, and sustainable wireless communication for future 6G networks.
Citation: Nguyen-Thi H, Chu-Thi N, Quang-Nguyen S, Tran-Tien D, Le-Thi A (2026) Double DQN-based secrecy energy efficiency and fairness performance in IRS-assisted NOMA systems with friendly jamming. PLoS One 21(7): e0352324. https://doi.org/10.1371/journal.pone.0352324
Editor: Farhan Ali, Shenzhen University, CHINA
Received: March 31, 2026; Accepted: June 9, 2026; Published: July 1, 2026
Copyright: © 2026 Nguyen-Thi et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant simulation data and parameters supporting the findings of this study are included within the manuscript and its Supporting Information files (Source file in Zip).
Funding: This work was supported by the Vietnam National Foundation for Science and Technology Development (NAFOSTED) under Grant 102.02-2023.33. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
1 Introduction
The rapid increase in large-scale connectivity and digital transformation services in 6G networks is posing serious challenges to global energy consumption [1,2]. Information and Communication Technology (ICT) infrastructure is a major energy consumer and contributes significantly to greenhouse gas emissions worldwide. According to research reports on environmental impact [3], the ICT sector accounts for approximately 3–4% of total global carbon emissions, and this figure is projected to continue to increase sharply due to the explosion of applications such as the Internet of Things (IoT), artificial intelligence, and big data applications. In particular, with next-generation wireless networks deploying dense base stations, using high-frequency bands, and increasingly complex signal processing, system energy consumption can increase exponentially if appropriate optimal solutions and policies are not in place.
In this context, building the sustainability of future network infrastructure needs to be based on research into green communication systems. This is not only a potential research direction but has become an essential requirement towards 6G networks [4]. In the design and operation of 6G systems, solutions to minimize energy consumption, optimize network resources, and limit carbon emissions are considered core measures. Therefore, integrating advanced energy-saving techniques across the physical and resource management layers is a crucial approach to balancing system performance and environmental impact.
Numerous studies and proposals have been proposed to meet the stringent energy-efficiency requirements of 6G networks. The increasing complexity of 6G networks to meet ever-evolving communication requirements leads to network designs with architectural features such as data-signal separation and dynamic resource allocation. This further highlights the need for energy-efficient, intelligent optimization mechanisms [3,4]. Consequently, many new physical-layer technologies have been proposed towards green and sustainable communication systems. Among them, Intelligent Reflecting Surface (IRS) has attracted considerable attention in the research community and is listed as one of the key technologies in beyond 5G (B5G) networks [5,6]. The IRS can reconfigure the propagation environment by using almost passive energy-consuming reflective elements. By flexibly adjusting the phase shifts of these elements, incident and reflected signals can be adjusted to produce a higher-quality resonant signal for legitimate users, reduce interference, and limit signal leakage into unwanted areas. Studies on IRS have recently been reported for both terrestrial and satellite communication systems, demonstrating its effectiveness in enhancing transmission reliability, coverage, and secrecy performance under different propagation conditions [7,8]. Compared to traditional active techniques, such as relay stations, multi-input multi-output (MIMO) technologies, and active beamforming, this technology does not use radio frequency (RF) chains to amplify the signal, making it relatively easy to integrate into networks and a promising low-power solution for power-constrained wireless systems. Therefore, the IRS contributes to improving the system’s spectral and energy efficiencies, enhancing its security against eavesdroppers [4,5], and reducing the carbon footprint of next-generation wireless networks [9].
Along with the IRS, Non-Orthogonal Multiple Access (NOMA) is recognized as an effective advanced access technique for supporting high-volume connectivity in beyond 5G and 6G networks [10]. Simply put, NOMA works by having multiple users share the same time-frequency resources via a power-domain NOMA (PD-NOMA) [11–13]. By efficiently utilizing these resources, NOMA improves spectrum utilization efficiency and user fairness while reducing transmitter power. This is an advantage of this technology over traditional orthogonal multiple access (OMA). Extensive research on NOMA has been reported in recent years, addressing a wide range of scenarios, including perfect/imperfect CSI and multi-hop communications. These studies further demonstrate the flexibility and applicability of NOMA in next-generation wireless networks [14,15]. Therefore, combining IRS and NOMA yields a robust solution that improves system performance metrics while reducing overall energy consumption [16–19]. In particular, IRS-aided NOMA systems can simultaneously leverage the benefits of passive beamforming and power-domain multiplexing. This offers a promising approach for green, energy-efficient 6G communication systems [20].
Besides energy-efficiency requirements, information security is a significant challenge in wireless communication networks, in general, and in 6G networks in particular, due to the open nature of the wireless environment [21]. Traditional security methods based on high-level cryptography – layers above the physical layer – often require high computational costs. This is unsuitable for large-scale IoT networks in the future because network devices have limited configuration options. As a result, physical layer security (PLS) has emerged as an effective solution. Unlike complex traditional cryptography methods, PLS exploits the randomness of the transmission channel to ensure system security. Specifically, jamming-friendly methods and artificial noise (AN) are two key approaches in this solution [22].
However, enhancing system security parameters using AN devices, jammers, beamforming, or cooperative relay transmission techniques often increases system power consumption. As a result, there is a trade-off between system security parameters and energy efficiency. This is even more significant given the stringent sustainability requirements in next-generation radio systems. To assess this trade-off, the proposed Security Energy Efficiency Index (SEE) is defined as the ratio of the security data rate to total power consumption [23]. Therefore, the optimal SEE in 6G and beyond not only enhances security but also ensures efficient energy use. However, when advanced wireless technologies are integrated, the system often becomes a non-convex problem and is difficult to solve using conventional mathematical methods. Thus, an effective, real-time optimization framework that achieves optimal SEE remains an open and challenging research problem [24,25].
Although many studies have focused on optimizing the performance of IRS-aided NOMA systems under security constraints, most current works primarily aim to maximize security rate or total system throughput, while inadequately addressing the energy-efficiency problem of security in the context of 6G green networks [20,26,27]. Some studies [28–30] have examined the energy efficiency index; however, they often rely on idealized assumptions, such as a perfect channel state or a static transmission environment [31,32]. Therefore, these findings are limited in their applicability to highly volatile real-world scenarios.
In addition, traditional optimization methods, such as alternating optimization (AO) [33], successive convex approximation (SCA) [34], or algorithms based on mathematical programming [35] often face high computational complexity and are difficult to scale as the system size increases [36]. Especially in IRS systems with a large number of elements, simultaneously optimizing power allocation for legitimate users and adjusting the phase shift of element reflections makes the problem complex and difficult to solve in real time. Furthermore, these optimization methods often require complete and accurate channel information, while the transmission environment of 6G networks is dynamic and random. As a result, these methods are not feasible for next-generation wireless network systems.
To overcome the above limitations, reinforcement learning (RL), especially deep learning methods such as Deep Q-Learning (DQL), has emerged as a promising tool in solving resource optimization problems in dynamic environments [37]. RL is based on learning optimal policies through interaction with the environment, without requiring accurate modeling of channel characteristics. Applying RL within a system enables it to adapt flexibly to changes in the transmission environment and significantly reduces computational complexity in practical implementations [38].
Based on the above observations, the authors are motivated to investigate and apply deep reinforcement learning techniques to the secrecy-energy-efficiency (SEE) performance optimization problem for the proposed IRS-aided PD-NOMA system, aiming to address the complex non-convexity and meet the real-time adaptation requirements of future green and smart wireless networks.
The main contributions of this paper can be summarized as follows:
- First, we propose an IRS-assisted NOMA communication framework with a friendly jammer in the THz band, accounting for both direct and IRS-reflected links under realistic channel conditions, including molecular absorption and Rician fading.
- Second, we formulate the secrecy energy efficiency (SEE) optimization problem with two objectives: maximizing total SEE and maximizing the minimum SEE, to enhance system efficiency and user fairness, respectively. This problem shows the trade-off between security and energy consumption in green wireless communication systems.
- Third, a Double Deep Q-learning-based framework is developed by modeling the problem as a Markov Decision Process (MDP), where both power allocation coefficients and IRS phase shifts are jointly optimized. In particular, Double DQN is employed to improve learning stability and convergence while requiring no explicit channel state information. Moreover, we design a constraint-aware reward mechanism that incorporates SINR and secrecy capacity requirements, enabling the learning agent to balance performance maximization and feasibility during training.
- Fourth, simulation results are implemented for our proposed Double DQN-based scheme and benchmark, including the DQN-based scheme and random policy, to demonstrate the advantages of Double DQN. Additionally, the IRS-assisted OMA scheme is considered to highlight our proposed IRS-NOMA performance in terms of SEE and user fairness.
- Finally, numerical analyses provide key insights into the impact of system parameters, such as the number of IRS elements, transmission power, and channel characteristics, highlighting their critical roles in achieving energy-efficient and secure communications.
The remainder of the paper is organized as follows. Section II presents the proposed IRS-assisted PD-NOMA system model and derives SINRs and system security capacity (SC) formulas. Section III builds the objective function problem with SEE formula cases. Section IV proposes a DQN-based solution method, modeling the problem as a Markov decision process and designing a Double DQN algorithm for SEE optimization. Section V presents simulation results and performance evaluations demonstrating the effectiveness of the proposed method across different system configurations and parameter settings. Finally, Section VI concludes the paper on the achieved results and affirms the role of the proposed system as a potential application in future green networks.
2 Proposed NOMA-assisted IRS system model and signal transmission
2.1 Proposed NOMA-assisted IRS system model
In this paper, we consider a downlink power-domain non-orthogonal multiple access (PD-NOMA) system assisted by a reflecting, reconfigurable intelligent surface (IRS), as illustrated in Fig 1, operating over Rician THz channels. The system consists of one ground base station (GS), one IRS with M passive elements, K legitimate users (LUs), one eavesdropper (E), and a friendly jammer (J). In this model, the ground station (GS) communicates with the end users via both the direct links and the IRS-reflected links. The distances from the GS to the IRS, the K end users, and the eavesdropper are denoted by ,
for
, and
, respectively. Likewise, the distances from the IRS to the n-th user and the eavesdropper are denoted by
and
, respectively. Moreover, the distances from friendly jammer J to
and Ev are denoted as
, and
. In our model, the friendly jammer J is assumed to be a cooperative and centrally coordinated node under the control of the ground station (GS). The GS has full knowledge of the jammer’s transmit power
and its location. The jammer operates in half-duplex mode, continuously transmitting a jamming signal to degrade the eavesdropper’s received signal. Finally, since E is a passive, non-cooperative entity, instantaneous CSI acquisition is practically infeasible. We adopt the statistical CSI assumption – the GS knows the eavesdropper’s location and the large-scale channel statistics.
The GS transmits a superimposed signal to all users based on the NOMA principle. Specifically, the transmitted signal is given by
where denotes the information signal intended for the k-th user, and
is the corresponding power allocation coefficient that satisfies
. And, without loss of generality, in this model, we assume that legitimate user 1 (LU1) is the user closest to the GBS and the IRS, followed by user 2 (LU2), and so on, with the
user being the farthest, then
with k = 1,...,K to ensure that users with poorer channel conditions are allocated more power.
All wireless channels are modeled as an independent Rician fading channels, especially, g denotes IRS-related channels while h denotes direct links. Then each Rician channel is generally expressed as
with and
Where is the Rician factor,
denotes the large-scale path loss. In the considered THz communication system, the path loss is modeled by incorporating both the free-space spreading loss and the molecular absorption loss. The path loss at distance d is expressed as [39]
where f denotes the carrier frequency in the THz band, d is the transmission distance, c is the speed of light, and represents the frequency-dependent molecular absorption coefficient of the propagation medium. This coefficient depends on frequency, humidity, atmospheric pressure, and temperature [39,40]. And
is the deterministic line-of-sight (LoS) component, and
is the non-line-of-sight (NLoS) component. In our paper, the channel vector from the ground base station (GS) to the IRS is represented by
, where M is the number of reflecting elements at the IRS, while channel vector from the IRS to LUs and eavesdropper are denoted by
and
, respectively, in
. In addition, the direct channel from the GS to the LUs and eavesdropper are denoted by
and
. All these links are assumed to experience independent Rician fading, following the Rician channel model given in (2), which consists of a deterministic line-of-sight (LoS) component and a random non-line-of-sight (NLoS) component weighted by the Rician factor.
Let denote the coefficient matrix, respectively, defined as
where represents the amplitude coefficients of the m-th element, respectively, satisfying
and
denotes the corresponding phase shifts. For clarity, the main notations used in the NOMA–IRS system model are summarized in Table 1.
2.2 Signal transmission
The received signal at the legitimate user consists of the superposition of the IRS-assisted link (
), the direct GS link (
), and the jammer signal from J (
) expressed as
Here, is an additive white Gaussian noise at
; the IRS-assisted signal is given by
where is the transmit power of the GS. The signal component of direct GS link
can be expressed as
And with
is the jamming power and
is the jamming signal, can be given by
Similarly, the received signal at the eavesdropper is expressed as
Here, is an additive white Gaussian noise at Ev. And, the channels from the friendly jammer J to the legitimate user and the eavesdropper are denoted by
and
, respectively. It is assumed that no propagation link exists between the jammer and the IRS. Therefore, the jamming signal is only received through the direct links at the legitimate user and the eavesdropper. Both
and
are assumed to follow independent Rician fading channels as described in (2).
2.3 SINRS and SC formulations
At the k-th user, in order to successfully decode its own signal , the legitimate user
is required to first decode and remove the signals of users with higher power allocation (i.e., users
) by employing successive interference cancellation (SIC). Without loss of generality, the users are ordered based on their channel conditions, where LU1 is the nearest user and
is the farthest user. It is assumed that the legitimate users are capable of estimating and mitigating the effect of the jamming signal; therefore, the interference caused by the jammer is negligible at the legitimate users. Accordingly, the received signal-to-interference-plus-noise ratio (SINR) at
for decoding the signal of user K is given by
Similarly, the SINR for decoding the signal of user at
is expressed as
In general, the SINR at for decoding the signal
at
is given by
For illustration, the SINRs corresponding to LU2 and LU1 at are respectively given by
Here, denotes the residual interference factor caused by imperfect successive interference cancellation (SIC). Specifically,
corresponds to perfect SIC, while
reflects the presence of residual interference due to decoding errors or hardware limitations, leading to incomplete cancellation of previously decoded signals. Moreover,
represents the variance of the additive white Gaussian noise (AWGN) at the k-th legitimate user, where the noise is modeled as a circularly symmetric complex Gaussian random variable with distribution
.
At the eavesdropper E, the SINR for intercepting the signal intended for the k-th legitimate user is expressed as
Here, denotes the direct channel from the GS to the eavesdropper, and
is the variance of the additive white Gaussian noise (AWGN) at E.
According to Shannon’s theorem, the achievable channel capacity is given by
where B denotes the system bandwidth.
For the farthest legitimate user , no prior SIC operation is required. Therefore, its achievable rate is expressed as
For the legitimate user, the signal of user K must first be successfully decoded before detecting its own signal. Hence, the achievable rate of
is written as
where is the minimum SINR threshold required for successfully decoding the signal of user K.
In general, for the k-th legitimate user , successful decoding of its own signal requires that the signals of users
be correctly decoded in advance via SIC. Thus, the achievable rate of
is given by
Similarly, for LU2 and LU1, their achievable rates can be expressed as
and
At the eavesdropper E, the achievable rate for intercepting the signal intended for user K is given by
For a general signal, the eavesdropper must also successfully decode the higher-power signals corresponding to users
before attempting to decode the
signal. Accordingly, the achievable interception rate at E is expressed as
In particular, for the signal intended for LU1, the achievable interception rate at the eavesdropper is given by
Based on the above achievable rates, the secrecy capacity (SC) of the legitimate user is defined as
where .
Equivalently, the secrecy capacity can be written as
By substituting Eq. 12 and Eq. 15 into Eq. 26, we can express as follows
3 Problem formulations
3.1 Power consumption model
To evaluate the secrecy energy efficiency (SEE) of the considered system, the total power consumption is modeled by accounting for both transmit power and circuit power components.
The total power consumption of the system is expressed as
where and
denote the transmit power at the ground station (GS) and the friendly jammer, respectively.
Here, and
represent the power amplifier efficiency (PAE) at the GS and the jammer, respectively. Typically, these values are set to constants, e.g.,
and
.
The term denotes the circuit power consumption at the GS. Similarly,
represents the total circuit power consumption of all K legitimate users. For simplicity, the circuit power consumption at each user is assumed to be identical.
The power consumption of the IRS is modeled as
where M is the number of reflecting elements at the IRS, denotes the power consumption of each passive element (typically in the range of 5–10 mW per element), and
is the power consumption of the IRS controller (typically 50–200 mW).
It is worth noting that, under the total transmit power constraint at the GS, the power allocation coefficients satisfy
. Therefore, the total transmit power at the GS remains constant, and the optimization primarily depends on the allocation of
among users.
Based on the above power consumption model, the secrecy energy efficiency will be evaluated in the following section under two optimization criteria, namely the maximization of the total SEE and the max–min SEE among users.
3.2 Case 1: Maximization of total secrecy energy efficiency
The total secrecy energy efficiency (SEE) of the system is defined as the ratio between the sum secrecy capacity of all legitimate users and the total power consumption, which is expressed as
By substituting the expression of the secrecy capacity, SEE(1) can be rewritten as
Accordingly, the optimization problem is formulated as
Here, and
, are introduced to ensure the system’s quality-of-service (QoS) and security requirements in which
is the minimum SINR at user k, and
is the minimum required secrecy capacity. In particular, the constraint
ensures that the difference between the legitimate channel capacity and the eavesdropping channel capacity remains above a prescribed threshold.
Proposition 1 (Feasible Region of Power Allocation). Under the SINR constraint in (32e) and the secrecy-capacity constraint in (32f), the feasible set of the power allocation coefficients is implicitly constrained by coupled lower bounds.
Specifically, each
depends on the power allocation of other users as well as the channel conditions and IRS configuration. Consequently, the feasible region is highly coupled and non-convex, and cannot be decomposed into independent closed-form bounds for individual users.
This intrinsic coupling significantly complicates the optimization problem and motivates the use of learning-based approaches.
Proof: The proof is provided in S1 Appendix A.
Remark 1: Although the above analysis yields explicit lower bounds on , these bounds are inherently coupled with other optimization variables and thus cannot be used to decouple the problem. As a result, the original constraints in (32e) and (32f) are preserved, while the derived expressions are mainly used to provide insights into the problem structure and guide the design of the proposed DRL-based solution.
3.3 Case 2: Max–min secrecy energy efficiency
To ensure fairness among users, the secrecy energy efficiency (SEE) is defined based on the worst-case user as
By substituting the secrecy capacity expression, SEE(2) can be rewritten as
Accordingly, the max–min SEE optimization problem is formulated as
Remark 2: The above formulation aims to maximize the minimum secrecy energy efficiency among all users, thereby guaranteeing fairness in the system. However, since the objective focuses on the worst-case user, the overall system efficiency may not be maximized.
To enable a fair comparison with Case 1, where the total SEE is directly optimized, we evaluate the total secrecy energy efficiency using the optimal solution obtained from the max–min SEE problem.
Let denote the optimal solution to the above problem. The corresponding total secrecy energy efficiency is then computed as
This evaluation ensures that both Case 1 and Case 2 are assessed under the same performance metric, thereby providing a fair and meaningful comparison between efficiency-oriented and fairness-oriented system designs.
Remark 3: Compared to the sum-SEE maximization, the max–min SEE problem introduces additional coupling due to the minimum operator across users. Together with the constraints in Proposition 1, the problem becomes highly non-convex and difficult to solve, which motivates the use of DRL-based approaches.
3.4 User fairness index
After analyzing the two objective function problems, Max-sum SEE and Max-Min SEE, in Subsections 3.3 and 3.4, this section proposes analyzing user fairness based on the achieved security energy efficiency.
To do this, Jain’s fairness index is used and defined as follows:
here, is the secrecy energy efficiency of the
user.
The fairness index is calculated using the results obtained after optimizing the problems in subsections 3.2 and 3.3, i.e., . This index is used to compare the fair performance of the total SEE maximization scheme and the maximum-minimum SEE scheme. A value of FISEE leaning towards 1 indicates fairness among users in the system, meaning users achieve approximately the same SEE performance. Conversely, when the fairness index is small and leans towards 0.5, it indicates that the system is unbalanced or that there is a large difference in users’ SEE. This index allows for a quantitative assessment of the trade-off between system efficiency and user fairness across different optimization strategies, as further illustrated in the results section.
4 Double DQN-based SEE optimization for IRS-assisted NOMA systems
In this section, we formulate the SEE optimization problems in subsections 3.2 and 3.3 by a Markov Decision Process (MDP) framework. Due to the high non-convexity and the presence of constraint system variables, obtaining a globally optimal solution using conventional optimization techniques is computationally challenging. To address this, Deep Q-Network (DQN) and Double Deep Q-Network (Double DQN) algorithms are employed to develop efficient resource allocation strategies for the IRS-assisted NOMA system. The main objective is to maximize the system’s SEE by jointly optimizing power allocation, IRS phase shifts, and transmit power. These deep reinforcement learning (DRL) methods enable the system to make adaptive decisions in dynamic environments without requiring prior knowledge of channel distributions.
Additionally, the SEE optimization problems in Case 1 and Case 2 are addressed using a unified DRL framework. Both problems are modeled as MDPs with identical state and action spaces, while distinct reward functions are designed to capture their respective optimization objectives.
4.1 MDP formulation for SEE optimization
The SEE optimization problem is formulated as a Markov Decision Process (MDP), defined by the tuple , where
,
,
,
, and
denote the state space, action space, state transition probability, reward function, and discount factor, respectively.
4.1.1 State space.
At time step t, the state captures the estimated channel-related state information (CSI) and system configuration available at the GBS, which is defined as
Here, denotes the channel from the GS to the IRS,
and
represent the IRS-to-user and IRS-to-eavesdropper channels, respectively. The terms
and
denote the direct links from the GS to the legitimate user and the eavesdropper, respectively, while
represents the jammer-to-eavesdropper channel. The CSI variables in the state space are assumed to be obtained through practical pilot-assisted channel estimation, received signal measurements, and SINR feedback mechanisms available at the BS. Therefore, the proposed framework does not require perfect global CSI for iterative optimization. The vectors
and
denote the power allocation coefficients and IRS phase shifts, respectively. The SINRs at the legitimate user and the eavesdropper are denoted by
and
, respectively, and
is the total power consumption defined in Section 3.
4.1.2 Action space.
The action at time step t corresponds to updating the system control variables, which is given by
Here, represents the adjustment of the power allocation coefficient for user k,
denotes the phase shift adjustment of the m-th IRS element, and
and
denote the transmit power adjustments at the GS and the jammer, respectively. These actions are discretized into finite levels to enable the application of DQN-based algorithms.
4.1.3 Reward function.
The reward function is designed to reflect the SEE optimization objective while enforcing the system constraints. To penalize constraint violations, two binary variables are introduced as
where and
indicate violations of the SINR and secrecy capacity constraints, respectively.
In the problem of Total SEE Maximization, the reward is defined as
In the case of Max–Min SEE problem, the reward is defined based on the worst-case user as
Here, and
are positive penalty coefficients that regulate the impact of constraint violations. The penalty terms discourage infeasible solutions by reducing the reward when the SINR or secrecy capacity requirements are not met. This reward formulation enables the deep reinforcement learning (DRL) agent to balance system efficiency with constraint satisfaction. Furthermore, modifying only the reward structure allows both optimization objectives to be addressed within a unified learning framework.
The notations employed in the DRL-based spectral energy efficiency (SEE) optimization framework are summarized in Table 2.
4.2 DQN-based algorithm for SEE optimization
In this subsection, a Deep Q-Network (DQN)-based algorithm is employed to solve the SEE optimization problem formulated as an MDP in Section 4.1. Due to the high dimensionality and non-convex nature of the problem, conventional optimization methods are difficult to apply. Therefore, DQN is adopted to learn an efficient resource allocation policy.
The DQN algorithm approximates the optimal action-value function using a deep neural network with parameters
. Given a state
, the agent selects an action
according to an
-greedy policy, where exploration and exploitation are balanced.
At each time step, the agent observes a transition , where the reward
is defined according to the SEE optimization objective described in Section 4.1.
Specifically, the reward is given as:
Case 1 (Total SEE Maximization):
Case 2 (Max–Min SEE):
The experiences are stored in a replay buffer , and mini-batches are sampled to train the network.
The target value for each transition is computed as
where is the target network, and
is the discount factor.
The loss function is defined as
The network parameters are updated via stochastic gradient descent, while the target network parameters
are periodically updated to stabilize training.
The overall objective of the agent is to learn an optimal policy that jointly optimizes the power allocation vector , IRS phase shift matrix
, and transmit powers
and
, so as to maximize the SEE while satisfying system constraints.
The detailed implementation of the proposed DQN-based SEE optimization is summarized in Algorithm 1.
Algorithm 1 DQN-Based SEE Optimization Algorithm
1: Initialize Q-network with random weights
2: Initialize target network with
3: Initialize replay buffer with capacity N
4: for episode e = 1 to Ne do
5: Initialize environment and obtain initial state s1
6: for time step t = 1 to T do
7: Select action using the
-greedy policy
8: Execute action to update
,
,
, and
9: Observe next state
10: if Case 1 then
11: Compute reward
12: else
13: Compute reward
14: end if
15: Store transition in
16: Sample a mini-batch from
17: for each sample do
18: Compute target
19: end for
20: Update by minimizing
21: Every C steps, update target network:
22: end for
23: end for
4.3 Double DQN-based algorithm for SEE optimization
Building upon the DQN-based framework presented in the previous subsection, a Double Deep Q-Network (Double DQN)-based algorithm is adopted to further improve the stability and convergence of the learning process.
In comparison with conventional DQN, Double DQN can reduce overestimation bias by separating action selection from evaluation. Specifically, the action is selected using the main Q-network, while the Q-value is evaluated using the target network. The detailed implementation of the Double DQN-based SEE optimization is presented in Algorithm 2.
Algorithm 2 Double DQN-Based SEE Optimization Algorithm
1: Initialize Q-network with random weights
2: Initialize target network with
3: Initialize replay buffer with capacity N
4: for episode e = 1 to Ne do
5: Initialize environment and obtain initial state s1
6: for time step t = 1 to T do
7: Select action using
-greedy policy
8: Execute action to update
9: Observe next state
10: if Case 1 then
11: Compute reward
12: else
13: Compute reward
14: end if
15: Store in
16: Sample mini-batch from
17: for each sample do
18: Select action:
19: Compute target:
20: end for
21: Update by minimizing
22: Every C steps:
23: end for
24: end for
The computational complexity of both DQN and Double DQN algorithms is approximately , where Ne is the number of episodes, T is the number of time steps,
is the mini-batch size, and
is the number of neural network layers. Compared with DQN, the Double DQN algorithm introduces negligible additional computational complexity while significantly improving training stability by reducing overestimation bias.
The -greedy strategy balances exploration and exploitation, with
gradually decreasing over training. Moreover, the experience replay mechanism enhances learning efficiency by breaking temporal correlations among samples.
Furthermore, the proposed Double DQN framework follows an offline training and online execution paradigm, which is well-suited for real-world deployment. Specifically, the agent is trained offline over E episodes using a simulated THz-Rician channel environment that statistically reflects the actual propagation conditions. The training phase, which has complexity , is performed once Prior to deployment, it imposes no real-time burden on the network. Once training is complete, the online execution phase requires only a single forward pass through the trained Q-network to determine the optimal action
given the observed state
. This inference operation has a fixed computational complexity of
, and can be executed in a few milliseconds on modern edge computing hardware or dedicated AI inference accelerators. This latency is well within the channel coherence time of the quasi-static THz-Rician fading model considered, making the approach suitable for real-time resource management.
5 Experimental results and discussion
In this section, we evaluate the performance of the proposed IRS-assisted NOMA framework in terms of secrecy energy efficiency (SEE). Two optimization strategies are considered: total SEE maximization and max-min SEE optimization. Furthermore, the user fairness index is investigated to highlight the trade-off between efficiency and fairness.
All simulations are implemented in MATLAB and Google Colab. The default system parameters are listed in Table 3. To provide clear insights while maintaining analytical generality, simulations are performed in a two-user scenario (U1 and U2), whereas the theoretical formulation is derived for a general system with K users.
As a benchmark, an OMA-based scheme (FDMA) is considered, in which the system bandwidth is divided among users via source allocation factors and
. For a fair comparison, the same optimization framework is applied to both the proposed NOMA scheme and the OMA baseline. Note that among OMA schemes, FDMA is selected as the most suitable representative for this system because it maintains a fixed IRS phase-shift matrix
across users and is naturally compatible with the wideband THz channel model. In comparison, TDMA would require an IRS reconfiguration at every time slot and reduce each user’s effective throughput by a factor of
, resulting in lower SEE—suggesting that NOMA’s advantage over TDMA would be even more pronounced than the NOMA-vs-FDMA gap shown in our results.
5.1 Sum SEE performance analysis (Case 1)
Fig 2 illustrates the convergence behavior of secrecy energy efficiency (SEE) with respect to the number of iterations for three approaches: our proposed Double DQN model (or Do-DQN model), the DQN model, and the random model, in the considered NOMA-IRS system with an eavesdropper and a friendly jammer. Our proposed Double DQN model achieves the fastest convergence among the three methods. The SEE value increases rapidly during the initial iterations, particularly from iteration 5–20, then gradually stabilizes at approximately 8.5 bits/Joule/Hz. This is the highest value of the objective function compared with the DQN and Random methods. This result demonstrates that the Double DQN model can learn an efficient policy to optimize the system’s SEE. In contrast, the DQN model also shows an increasing trend in SEE with increasing iterations is slower than that of the Double DQN model. And the DQN algorithm achieves a lower SEE value of approximately 8.1–8.2 bit/Joule/Hz. Meanwhile, the random method maintained significantly lower SEE; the achieved SEE values ranged from 4.8 to 5.2 bits/Joule/Hz and showed no clear convergence trend. The main reason is that the random strategy did not leverage system state information to improve decision-making. Overall, the results in Fig 2 demonstrate that the Double DQN-based approach significantly outperforms both the DQN and random models in terms of convergence speed, stability, and SEE performance, highlighting the effectiveness of the proposed learning-based optimization scheme for the considered NOMA-IRS system with a friendly jammer.
It is evident that the Double DQN algorithm converges faster and achieves the highest SEE performance among all considered methods. Hence, in the subsequent experiments, only the trained Double DQN model is employed for performance evaluation to ensure both efficiency and stability.
Fig 3 presents the convergence lines of the SEE for both IRS-assisted NOMA (solid line) and IRS-assisted OMA (dashed line) systems under the Double DQN model. Both systems gradually improve their SEE values as the number of iterations increases and eventually converge to stable performance levels. From Fig 3, we can see that the NOMA system achieved higher SEE than the OMA system in all iterations. Specifically, NOMA achieved the highest and most stable SEE value of 8.5 bits/Joule/Hz, while OMA reached only about 5 bits/Joule/Hz. Furthermore, the NOMA model converged faster, reaching stable performance after approximately 25 iterations, while the OMA method converged more slowly and stabilized at a lower SEE.
Fig 4 shows the effects of the number of IRS reflecting elements, M, on the sum of secrecy energy efficiency (SEE) at different base station transmit power levels: =25 dBm,
=30 dBm, and
=35 dBm. The SEE initially increases as the number of IRS elements grows from M = 16 to M = 32. However, as the number of reflecting elements increases beyond M = 32, the sum of SEE gradually decreases. This result can be explained as follows. A larger number of IRS elements improves the received signal power, but also increases circuit power consumption. As a result, the gain in energy efficiency becomes marginal and eventually decreases when hardware power consumption dominates the power of the system. Fig 4 also shows that higher base-station transmit power leads to better SEE performance. Specifically, the sum of SEE achieved with
= 35 dBm is consistently higher than that with
= 30 dBm and
= 25 dBm in all the values considered of M. Nevertheless, excessive transmit power may also increase overall energy consumption, which helps explain the relatively small improvement in SEE as M increases. Overall, the results indicate that there is an optimal number of IRS elements (around M = 32 in this scenario) that maximizes SEE for the considered NOMA-IRS system. Further increasing the IRS size does not improve SEE due to additional hardware power consumption. Finally, from Fig 4, we see that the total SEE of our proposed NOMA (solid lines) system is higher than that of the OMA (dashed lines) system across the cases considered.
Fig 5 shows the variation of total secure energy efficiency (SEE) with transmit power for different atmospheric absorption coefficients
in the considered THz communication channel. The transmit power ranges from 5 dBm to 50 dBm. In the simulation, the absorption coefficient
varies from 0.4 to 0.60, to represent various atmospheric absorption conditions in THz wireless environments. The total SEE increases monotonically with transmit power for all values of
. As the transmit power increases from 5 dBm to about 35 dBm, the total SEE improves. This is due to the enhanced received signal strength at the legitimate user, which increases the system’s achievable security capacity and overall energy-security efficiency. However, at about 40 dBm, SEE growth slows and approaches saturation. The figure also shows that the atmospheric absorption coefficient
significantly affects the system’s performance. Lower
values give much higher total SEE. The system achieves the highest SEE at
for all transmit power levels. In contrast,
yields the lowest SEE. This outcome is typical in THz communication. Higher absorption coefficients result in greater atmospheric signal attenuation, weakening the received signal power at valid receivers and reducing the achieved security rate and overall energy efficiency. These results show that both transmit power and the atmospheric absorption properties of the THz channel are critical for total SEE performance. Finally, the Fig 5 shows that the total SEE of our proposed NOMA (solid lines) system is higher than that of the OMA (dashed lines) system across the cases considered.
Fig 6 illustrates the effect of the distance between the eavesdropper and the ground base station (GS) on the total secrecy energy efficiency (SEE) across different transmit power levels . As the Eve–GBS link distance increases from 10 m to 40 m, the SEE improves significantly, particularly between 10 m and 20 m. For eavesdroppers close to the base station (10 m), the SEE remains low for all transmit power levels because the strong received signal at the eavesdropper reduces the secrecy rate and degrades overall SEE. When the distance grows beyond 25 m, SEE stabilizes, indicating that further increases in distance yield negligible improvement. The figure also demonstrates that higher transmit power results in better SEE, with
dBm performing best, followed by
dBm and
dBm, as increased power benefits legitimate users’ signal quality. Overall, the results confirm that greater separation between the eavesdropper and the base station and higher transmit power boost SEE in the NOMA-IRS system. Lastly, the NOMA scheme (solid lines) consistently achieves a higher SEE than the OMA scheme (dashed lines) across all conditions considered. This performance gain is due to the superior spectral efficiency and more flexible resource allocation of NOMA, which enables more efficient utilization of transmit power than OMA.
Although the results in Section 5.1 highlight the benefit of maximizing total SEE, such a strategy does not always guarantee a fair performance across users. In particular, users with weaker channels may suffer from significantly lower SEE. To alleviate this issue, we next consider a max–min SEE formulation that explicitly targets the worst-case user.
5.2 Max–Min SEE Performance Analysis (Case 2)
In this subsection, we examine the SEE performance of the proposed IRS-assisted NOMA system under the max–min optimization framework (Case 2), which aims to improve the worst-case user’s performance by maximizing the minimum SEE across all users (Fig 7).
Fig 7 and 8 shows the convergence behavior of the considered algorithms under the max–min SEE criterion. Unlike the sum-SEE case, where the objective function is evaluated based on the total SEE across all users, the max–min formulation focuses only on the worst-case user, i.e., the user with the minimum SEE. Therefore, the converged SEE value in this figure is naturally much lower than that obtained in the sum-SEE case, since it only reflects the performance of the weakest user rather than the aggregate system performance. From the figure, it can be observed that the learning-based algorithms still exhibit clear convergence behavior under the max–min optimization framework. In particular, the proposed Double DQN model converges faster and achieves a higher minimum SEE than the conventional DQN model, whereas the random model fluctuates at a much lower level and shows no clear convergence trend. This result confirms that our proposed algorithm effectively solves the fairness-oriented max—min SEE optimization problem and maintains stable learning performance even under a more stringent objective function.
The results above confirm that the proposed Do-DQN-based algorithm can achieve stable convergence within the max–min SEE optimization framework. After validating the convergence of the learning process, the subsequent simulations evaluate the system performance using the sum SEE metric to further investigate the overall efficiency of the considered NOMA–IRS system.
Fig 9 illustrates the impact of the number of IRS reflecting elements M on the secrecy energy efficiency (SEE) under different transmit power levels for both NOMA and OMA schemes. It is worth noting that the learning model is trained using the max–min SEE criterion to guarantee fairness among users, while the performance shown in this figure is evaluated as the sum SEE across all users after training. From Fig 6, we can observe that the SEE first increases as the number of IRS elements grows from M = 16 to M = 32. However, as the number of IRS elements increases beyond M = 32, the SEE gradually decreases. This phenomenon can be attributed to additional power consumption in the circuit due to the IRS elements. Although a larger IRS can further enhance signal gain, the increased hardware power consumption reduces the system’s overall energy efficiency. In addition, the figure shows that higher transmit power leads to better SEE performance across all values of M. Specifically, the case with
dBm consistently achieves the highest SEE, followed by
dBm and
dBm. This is because higher transmit power increases the achievable secrecy capacity of legitimate users, thereby increasing the SEE. Furthermore, the NOMA scheme consistently outperforms the OMA scheme across all configurations, demonstrating its superiority in improving the worst-user performance. This confirms that NOMA is more effective at achieving fairness-oriented optimization than conventional OMA.
Fig 10 presents the corresponding total SEE achieved under the optimal policy obtained from the max–min SEE optimization problem for both NOMA and OMA schemes. It can be observed that the total SEE follows a similar trend: it increases with M up to a certain point, then decreases due to the rising IRS power consumption. However, compared to the total SEE obtained from the sum SEE maximization (Case 1), the values in Fig 11 are relatively lower. This is because the max–min optimization prioritizes worst-case user performance, inevitably sacrificing some of the overall system efficiency. However, these results show that our proposed IRS-assisted NOMA system still achieves a significantly higher total SEE than the OMA scheme, meaning that NOMA maintains its efficiency advantage even during the optimization process aimed at equity.
Fig 11 illustrates the impact of the distance between the eavesdropper and the ground base station (Eve–GS link) on the secrecy energy efficiency (SEE) under different transmit power levels . It should be noted that the learning model is trained using the max–min SEE criterion to ensure fairness among users, while the performance shown in this figure is evaluated based on the sum SEE after training. From the figure, it can be observed that the SEE increases significantly as the distance between the E and GS increases. When the E is located close to the base station (e.g., 10 m), the SEE remains low. And, the distance increases from 10 m to approximately 20 m, the SEE improves rapidly for all considered transmit power levels. When the eavesdropper is located further away from the base station (beyond 25 m), the SEE gradually approaches a stable region. In addition, it is clear that higher transmit power levels consistently yield better SEE performance. Specifically, the case with
dBm provides the highest SEE, followed by
dBm and
dBm. This is because a higher transmit power increases the received signal strength at legitimate users, thereby enhancing the achievable secrecy rate and increasing the system’s overall secrecy energy efficiency. Finally, Fig 11 also shows that the NOMA system achieves better minimum SEE efficiency than the OMA system at different transmit power levels.
Fig 12 illustrates the impact of the GS–eavesdropper (GS–E) distance on the total SEE under the max–min SEE optimization strategy. It can be observed that the total SEE increases significantly as the GS–E distance increases from 15 m to approximately 25 m, then gradually saturates at larger distances. Moreover, the proposed IRS-assisted NOMA scheme consistently outperforms the OMA scheme across all considered transmit power levels. It is also observed that the improvement in total SEE diminishes with increasing distance. These results confirm that, even under the fairness-oriented max–min SEE optimization, the system can still achieve considerable total SEE gains, especially when the eavesdropper is located farther from the transmitter.
Fig 13 illustrates the impact of the atmospheric absorption coefficient on the total SEE under the max–min SEE optimization framework for both NOMA and OMA systems. It can be observed that the total SEE increases monotonically with the transmit power
for all considered values of
. This is because higher transmit power increases the received signal strength for legitimate users, thereby improving secrecy capacity and, consequently, the overall SEE. However, the performance is significantly affected by the atmospheric absorption coefficient. Specifically, as
increases from 0.4 to 0.6, the total SEE degrades considerably for both NOMA and OMA schemes. Furthermore, the proposed NOMA model based on IRS achieves significantly better SEE performance than the OMA model across all values of
and
. More specifically, the performance gap becomes more pronounced at lower absorption levels (e.g.,
), where channel conditions are more favorable, enabling NOMA to better exploit multiplexing in the power domain. Meanwhile, under severe absorption conditions (e.g.,
), the performance of both options decreases, and the gap between NOMA and OMA becomes less significant. Finally, although maximum-minimum SEE optimization prioritizes fairness among users, the total SEE still exhibits a clear performance trend with both transmit power and channel conditions, demonstrating the robustness of the proposed framework across various THz transmission environments.
5.3 Trade-off analysis between SEE and fairness
To further investigate the fairness performance of the considered system, we evaluated Jain’s fairness index among users under both the max–sum SEE and max–min SEE optimization schemes. Fig 14 illustrates the fairness index for both NOMA and OMA systems in both cases (case 1 and case 2) versus the number of IRS elements. It can be observed that the max–min optimization consistently achieves a higher fairness index compared to the max–sum SEE scheme. This is expected because the max–min formulation explicitly maximizes the SEE of the worst user, thereby balancing the performance among users. Furthermore, Fig 14 shows that the User Fairness Index of the OMA system is similar to that of the NOMA system. As M increases from small values, the fairness index increases and then stabilizes. However, OMA consistently exhibits lower levels of fairness than NOMA in both scenarios. This result may be due to OMA’s fixed resource allocation, which limits its ability to balance user performance. These findings suggest that NOMA uses IRS more effectively to enhance SEE balance among users.
Similarly, Fig 15 presents the fairness index with respect to the distance between the ground station and the eavesdropper. The results again show that the max–min scheme significantly improves the system’s fairness performance. Although the max–min approach may yield a slightly lower sum SEE than the max–sum scheme, it effectively enhances fairness among users by preventing the performance of weaker users from being excessively degraded. The OMA results follow a similar trend. The fairness index increases quickly as the GS–E distance grows from small values, and then changes only slightly when the distance becomes larger. Even so, OMA still offers lower fairness than NOMA in both cases. The gap is more pronounced in the max–min setting, where NOMA is more effective at improving the weakest user’s performance. These observations indicate that, although OMA benefits from better channel conditions, it is less flexible in balancing user performance. On the other hand, NOMA achieves a more even distribution of SEE among users.
Overall, these results confirm that the proposed max-min SEE optimization framework provides a better balance between system efficiency and user fairness in the considered NOMA–IRS secure communication system.
6 Conclusion
In this paper, we investigated the IRS-assisted NOMA network model in the presence of an eavesdropper and a friendly jammer under THz communication channels. Two optimization objectives were considered: maximizing total SEE and the max–min SEE design, which aims to improve the performance of the worst-case user. To address the high non-convexity and the constraint system variables, a Markov Decision Process (MDP) and deep reinforcement learning techniques, including Deep Q-Network (DQN) and Double DQN, were employed. The simulation results demonstrated that Double DQN converges faster and achieves better SEE performance than conventional DQN and random strategies. Furthermore, to highlight the SEE of our proposed NOMA system across various system configurations, the OMA system was used as a benchmark. Although the max–min SEE formulation reduces total SEE relative to sum-SEE maximization, it significantly improves the performance of the weakest user, resulting in a more balanced system. The impacts of important system parameters, such as the number of IRS elements, the GS–eavesdropper distance, and the THz absorption coefficient, were also analyzed, showing their critical role in SEE performance. Overall, these results confirm that the integration of NOMA, IRS, and DRL provides an effective and energy-efficient framework for enhancing physical layer security while ensuring user fairness. The proposed approach offers a promising solution for sustainable, green 6G wireless communication systems operating in dynamic and complex environments.
References
- 1.
Alliance N. 6G drivers and vision. NGMN Alliance; 2021.
- 2. Uitto M, Mäkelä J, Apilo O, Rantala SJ, Pinola J, Gupta N. Study and analysis of runtime energy consumption in cellular 5G network: an empirical approach. J Wirel Commun Netw. 2026;2026(1).
- 3. Malmodin J, Lövehagen N, Bergmark P, Lundén D. ICT sector electricity consumption and greenhouse gas emissions – 2020 outcome. Telecommun Policy. 2024;48(3):102701.
- 4. Li L. Research on future 6G green wireless networks. Green Technol Sustainab. 2025;3(2):100156.
- 5. Masood F, Ahmad J, Al Mazroa A, Alasbali N, Alazeb A, Alshehri MS. Multi IRS‐Aided Low‐Carbon Power Management for Green Communication in 6G Smart Agriculture Using Deep Game Theory. Computat Intell. 2025;41(1).
- 6. Nguyen TP, Vo DT, Vu Q-S, Tran M, Nguyen Q-S, Kim T. RIS-Aided Multi-Antenna IoT Systems: Performance Evaluation under MRC Combining. AEEE. 2025;23(3).
- 7. Nguyen NT, Nguyen H-N, Bui M-V. Performance Analysis of RIS-equipped UAV Communication Network under Hardware Impairments. AEEE. 2025;23(3).
- 8. Le S-P, Nguyen TN, Le-Tien T, Duy TT, Nguyen T-T, Ng DWK, et al. On the Secrecy Performance of Reconfigurable Intelligent Surfaces-Assisted Satellite Networks Under Shadow-Rician Channels. IEEE Trans Aerosp Electron Syst. 2025;61(3):6794–808.
- 9.
Abualhayjaa M, Hassouna AS, Centeno A, Rehman MU, Imran MA, Mohjazi L. Intelligent reflective surfaces (IRSs) for green networks. IET. 2023.
- 10. Liu Y, Zhang S, Mu X, Ding Z, Schober R, Al-Dhahir N, et al. Evolution of NOMA Toward Next Generation Multiple Access (NGMA) for 6G. IEEE J Select Areas Commun. 2022;40(4):1037–71.
- 11. Sobhi-Givi S, Nouri M, Shayesteh MG, Behroozi H, Kwon HH, Piran MdJ. Efficient Optimization in RIS-Assisted UAV System Using Deep Reinforcement Learning for mmWave-NOMA 6G Communications. IEEE Internet Things J. 2025;12(14):26042–57.
- 12. Anh LT, Kong HY. Secrecy performance of an uplink-downlink cooperative PD-NOMA DF network in PLS. Int J Electron. 2020;107(11):1861–86.
- 13. Le A-T, Vu T-H, Nguyen TN, Vu Minh B, Voznak M. Robust Covertness With Coordinated NOMA Strategy. IEEE Commun Lett. 2025;29(12):2790–4.
- 14. Tu L-T, Phan V-D, Nguyen TN, Tran PT, Duy TT, Nguyen Q-S, et al. Performance Analysis of Multihop Full-Duplex NOMA Systems with Imperfect Interference Cancellation and Near-Field Path-Loss. Sensors (Basel). 2023;23(1):524. pmid:36617128
- 15. Özduran V, Mohammadi M, Nomikos N, Ansari IS, Trakadas P. On the performance of uplink power-domain NOMA with imperfect CSI and SIC in 6G networks. J Commun Netw. 2024;26(4):445–60.
- 16.
Thi HN, Kieu TX, Truong LH, Le Thi A. Resource allocation for NOMA/IRS network with energy harvesting in presence of Hardware Impairment. In: 2023 IEEE 3rd International Conference in Power Engineering Applications (ICPEA). IEEE; 2023. p. 169–74.
- 17.
Le Thi A, Thi HN, Viet TP, Bao VNQ. Performance evaluation of cooperative NOMA-IRS network using particle swarm optimization. In: 2021 8th NAFOSTED Conference on Information and Computer Science (NICS). IEEE; 2021. p. 296–301.
- 18. Kieu-Xuan T, Nguyen-Thi H, Le-Thi A. Multi-Objective Optimization-Based GA in PLS of IRS-Assisted PDNOMA Communication. IEEE Access. 2024;12:87361–83.
- 19. Nguyen TN, Nguyen Q-S, Minh Quan N, Van Chien T, Vu Minh B, Le-Tien T. Reliability and Security Analysis of Active RIS-Assisted IoT NOMA Networks Over Nakagami- m Fading Channels. IEEE Internet Things J. 2026;13(7):14404–15.
- 20. Sur SN, Singh AK, Tran HQ, Vishwakarma P, Imoize AL, Li C-T. A State-of-the-Art Survey on IRS-NOMA for Integrated Sensing and Communication. IEEE Access. 2024;12:186087–123.
- 21. Zhang S, Zhu D, Liu Y. Artificial intelligence empowered physical layer security for 6G: State-of-the-art, challenges, and opportunities. Comput Netw. 2024;242:110255.
- 22. Chen S, Ji Y, Jiang Y, Duan W, Choi J, Zhang G, et al. Optimal RIS Allocations for PLS With Uncertain Jammer and Eavesdropper. IEEE Trans Consumer Electron. 2023;69(4):927–36.
- 23. Jiang Y, Zou Y. Secrecy Energy Efficiency Maximization for Multi-User Multi-Eavesdropper Cell-Free Massive MIMO Networks. IEEE Trans Veh Technol. 2023;72(5):6009–22.
- 24. Soderi S, Zappone A. Secrecy Energy Efficiency of Hybrid Wireless Body Area Networks. IEEE Trans on Mobile Comput. 2026;25(3):3649–62.
- 25. Zhang Y, Lu Y, Zhang R, Ai B, Niyato D. Deep Reinforcement Learning for Secrecy Energy Efficiency Maximization in RIS-Assisted Networks. IEEE Trans Veh Technol. 2023;72(9):12413–8.
- 26. Binzagr F, Prabuwono AS, Alaoui MK, Innab N. Energy efficient multi-carrier NOMA and power controlled resource allocation for B5G/6G networks. Wireless Netw. 2024;30(9):7347–59.
- 27. Asif M, Ihsan A, Khan WU, Ali Z, Zhang S, Wu SX. Energy-Efficient Beamforming and Resource Optimization for STAR-IRS Enabled Hybrid-NOMA 6G Communications. IEEE Trans on Green Commun Netw. 2023;7(3):1356–68.
- 28. Qiao T, Cao Y, Tang J, Deng N, Zhao N, Li Y. Energy Efficiency Maximization for Active IRS-Assisted Uplink NOMA Systems. IEEE Wireless Commun Lett. 2024;13(6):1561–5.
- 29. Yue X, Liu Y. Performance Analysis of Intelligent Reflecting Surface Assisted NOMA Networks. IEEE Trans Wireless Commun. 2022;21(4):2623–36.
- 30. Al-Obiedollah H, Bany Salameh H, Abdel-Razeq S. Energy-Spectral Efficiency Trade-Off in IRS-Assisted NOMA Systems: A Weighted Product Method. IEEE Trans on Green Commun Netw. 2025;9(2):635–44.
- 31. Almaghthawi S, Alsusa E, Al-Dweik A. On the Performance of IRS-Aided NOMA in Interference-Limited Networks. IEEE Wireless Commun Lett. 2024;13(2):560–4.
- 32. Omid Y, Shahabi SMM, Pan C, Deng Y, Nallanathan A. Robust Beamforming Design for an IRS-Aided NOMA Communication System With CSI Uncertainty. IEEE Trans Wireless Commun. 2024;23(2):874–89.
- 33. Tang H, Wu Q, Xu J, Chen W, Li B. A Novel Alternative Optimization Method for Joint Power and Trajectory Design in UAV-Enabled Wireless Network. IEEE Trans Veh Technol. 2019;68(11):11358–62.
- 34. Liu A, Lau VKN, Kananian B. Stochastic Successive Convex Approximation for Non-Convex Constrained Stochastic Optimization. IEEE Trans Signal Process. 2019;67(16):4189–203.
- 35. Blazewicz J, Dror M, Weglarz J. Mathematical programming formulations for machine scheduling: A survey. Eur J Operat Res. 1991;51(3):283–300.
- 36. Liu X, Qi H, Jia S, Guo Y, Liu Y. Recent Advances in Optimization Methods for Machine Learning: A Systematic Review. Mathematics. 2025;13(13):2210.
- 37. Abdelghany HM. Dynamic Resource Management and Task Offloading Framework for Fog Computing. J Grid Comput. 2025;23(2).
- 38. Chen X, Qu G, Tang Y, Low S, Li N. Reinforcement Learning for Selective Key Applications in Power Systems: Recent Advances and Future Challenges. IEEE Trans Smart Grid. 2022;13(4):2935–58.
- 39. Jornet JM, Akyildiz IF. Channel Modeling and Capacity Analysis for Electromagnetic Wireless Nanonetworks in the Terahertz Band. IEEE Trans Wireless Commun. 2011;10(10):3211–21.
- 40. Kokkoniemi J, Lehtomäki J, Juntti M. A discussion on molecular absorption noise in the terahertz band. Nano Commun Netw. 2016;8:35–45.